-- Logs begin at Fri 2022-08-05 04:23:22 UTC, end at Fri 2022-08-05 06:08:13 UTC. -- Aug 05 05:04:28.145160 dv-cinder-815582-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 05:04:28.154487 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 05:04:28 2022] *** Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: nodename: dv-cinder-815582-14-iscsi Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: machine: x86_64 Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: clock source: unix Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: pcre jit disabled Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: detected number of CPU cores: 4 Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: current working directory: / Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: detected binary path: /usr/bin/uwsgi-core Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: your processes number limit is 47680 Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: your memory page size is 4096 bytes Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: detected max file descriptor number: 2048 Aug 05 05:04:28.157037 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: lock engine: pthread robust mutexes Aug 05 05:04:28.157859 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: thunder lock: enabled Aug 05 05:04:28.157859 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 05:04:28.157859 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 05:04:28.196164 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: Python main interpreter initialized at 0x55abef4d79c0 Aug 05 05:04:28.196164 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: python threads support enabled Aug 05 05:04:28.196164 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: your server socket listen backlog is limited to 100 connections Aug 05 05:04:28.196164 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: your mercy for graceful operations on workers is 90 seconds Aug 05 05:04:28.196539 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 05:04:28.196539 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: *** Operational MODE: preforking *** Aug 05 05:04:28.196818 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: *** uWSGI is running in multiple interpreter mode *** Aug 05 05:04:28.196818 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: spawned uWSGI master process (pid: 103384) Aug 05 05:04:28.196997 dv-cinder-815582-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 05:04:28.197998 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: spawned uWSGI worker 1 (pid: 103385, cores: 1) Aug 05 05:04:28.197998 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: spawned uWSGI worker 2 (pid: 103386, cores: 1) Aug 05 05:04:28.197998 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 05:04:28.840006 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 05:04:28.841845 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 05:04:29.901238 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:04:29.901238 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: from cryptography.utils import int_from_bytes Aug 05 05:04:29.901884 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:04:29.901884 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: from cryptography.utils import int_from_bytes Aug 05 05:04:29.902624 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:04:29.902624 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: from cryptography.utils import int_from_bytes Aug 05 05:04:29.903105 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:04:29.903105 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: from cryptography.utils import int_from_bytes Aug 05 05:04:32.361781 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 05:04:32.362355 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 05:04:32.362432 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 05:04:32.362792 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 05:04:32.363017 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 05:04:32.363372 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 05:04:32.363795 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.363898 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 05:04:32.363979 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.364046 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.364187 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 05:04:32.364342 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.364547 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 05:04:32.364692 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.364776 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 05:04:32.364919 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.365173 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.365318 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.365460 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.365565 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.365802 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.365932 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.366075 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.366185 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.366411 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.366536 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.366702 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-14-iscsi {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.366793 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.367041 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.367229 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.367373 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.367795 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.367924 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368045 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368045 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368302 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368302 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368551 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368672 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368799 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-14-iscsi {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.368911 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.369033 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.369176 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.369373 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.369576 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.370808 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.370967 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371118 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371249 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371249 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371498 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371498 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371735 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.371735 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372003 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372146 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372275 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372404 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372534 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372646 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372775 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.372896 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373024 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373152 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373282 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373403 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-14-iscsi {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373521 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373648 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373776 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.373903 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374014 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374141 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374268 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374469 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374610 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374723 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.374870 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-14-iscsi {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375001 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375121 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375265 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375387 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375522 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375651 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.375966 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376097 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376233 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376363 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376501 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376646 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376771 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.376891 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377010 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377145 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377272 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377394 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377552 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377675 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377794 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.377998 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.378175 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.378317 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.378443 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.378590 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.378718 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.378921 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379098 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379244 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379369 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379497 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379626 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379814 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.379956 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380116 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380247 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380372 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380509 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380637 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380777 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.380899 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.381019 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.381181 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.381327 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.381484 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.381622 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.381819 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382007 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382154 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382289 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382413 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382533 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382662 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382799 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.382929 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.383056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.383213 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.383342 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.383529 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.383721 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.383887 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384026 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384157 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384279 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384399 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384535 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384732 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.384910 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385041 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385175 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385299 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385436 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385595 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385732 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.385930 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386195 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386195 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386454 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386580 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386701 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386823 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.386949 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.387111 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.387251 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.387465 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.387639 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.387837 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.387966 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.388190 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.388471 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.388599 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.388720 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.388849 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.388978 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389113 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389242 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389375 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389497 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389618 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389737 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.389936 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390113 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390245 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390369 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390503 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390637 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390770 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.390892 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391083 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391260 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391392 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391532 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391659 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391807 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.391930 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.392051 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.392270 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.392511 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.392645 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.392769 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.392899 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393029 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393151 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393287 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393417 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393539 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393687 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.393814 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394017 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394207 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394343 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394476 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394601 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.394889 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395021 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395211 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395390 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395531 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395657 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395829 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.395976 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396110 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396333 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396462 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396583 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396714 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396843 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.396974 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397104 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397226 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397346 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397518 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397657 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397789 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.397996 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.398119 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.398247 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.398381 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.398503 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.398699 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.398876 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399007 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399131 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399272 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399404 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399526 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399646 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399864 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.399997 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.400169 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.400301 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.400467 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.400599 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.400762 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.400893 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401050 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401185 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401379 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401574 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401708 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401844 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.401967 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402088 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402215 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402337 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402493 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402641 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402778 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.402900 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.403119 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.403308 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.403450 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.403587 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.403723 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.403902 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.404031 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.404152 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.404272 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.404403 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.404618 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.404804 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.404949 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.405074 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.405214 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.405335 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.405471 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.405593 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.405799 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.405977 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.406124 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:04:32.406260 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.406479 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.406605 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.406734 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.406856 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.407065 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.407232 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.407395 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.407603 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.407740 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.407921 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408063 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408186 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408307 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408426 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408569 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408707 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.408910 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.409088 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.409230 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.409355 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.409496 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.409633 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.409829 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410032 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410184 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410311 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410443 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410575 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410697 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.410825 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411034 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411213 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411343 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411491 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411615 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411736 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.411975 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.412154 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.412287 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.412436 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.412560 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.412681 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.412905 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413093 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413227 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413370 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413504 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413628 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413757 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.413878 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414093 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414283 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414423 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414549 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414676 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414797 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.414977 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.415110 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.415288 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.415425 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.415592 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.415716 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.415903 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416034 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416213 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416349 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416520 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416662 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416825 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.416966 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.417151 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.417276 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.417458 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.417592 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.417766 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.417905 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418064 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418186 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418372 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418504 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418675 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418806 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.418976 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.419099 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.419277 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.419488 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.419622 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.419743 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.419901 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420022 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420157 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420287 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420455 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420582 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420749 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.420873 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421060 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421186 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421378 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421502 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421675 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421800 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.421974 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.422098 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.422281 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.422404 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.422582 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.422706 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.422881 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423004 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423184 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423308 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423541 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423664 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423875 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.423999 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.424178 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.424642 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.424818 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.424952 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.425131 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.425252 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.425432 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.425555 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.425732 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.425870 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426038 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426161 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426334 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426634 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426754 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.426943 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427042 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427247 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427357 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427546 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427666 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427873 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.427977 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.428180 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.428264 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.428483 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.428577 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.428785 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.428867 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.429088 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.429179 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.429393 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.429489 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.429700 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.429785 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430012 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430105 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430329 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430415 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430636 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430725 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.430940 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431031 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431235 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431322 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431539 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431623 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431856 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.431962 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.432154 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.432247 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.432450 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.432536 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.432751 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.432845 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433051 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433155 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433344 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433431 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433638 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433733 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.433932 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434017 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434227 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434319 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434539 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434633 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434839 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.434923 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.435130 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.435213 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.435427 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.435512 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.435719 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.435829 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436045 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436128 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436364 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436448 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436668 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436758 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.436971 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437063 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437271 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437359 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437568 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437658 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437895 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.437978 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.438196 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.438281 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.438497 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.438581 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.438799 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.438893 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.439135 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.439226 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.439450 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.439535 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.439786 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.439890 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440086 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440174 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440396 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440480 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440696 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440795 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.440999 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441090 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441300 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441391 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441611 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441705 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441908 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.441994 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.442217 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.442304 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.442522 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.442615 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.442842 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.442927 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.443151 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.443254 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.443458 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.443543 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.443757 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.443872 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444092 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444177 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444393 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444478 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444694 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444786 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.444996 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445081 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445296 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445381 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445603 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445690 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445904 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.445989 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.446212 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.446304 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.446513 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.446598 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.446814 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.446900 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.447112 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.447196 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.447419 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.447504 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.447712 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.447927 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448044 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448139 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448347 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448431 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448666 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448764 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.448969 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449091 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449273 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449360 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449569 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449663 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449878 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.449970 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.450181 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.450268 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.450484 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.450583 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.450864 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.451076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.451160 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.451378 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.451464 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.451681 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.451786 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452009 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452094 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452314 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452409 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452609 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452696 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452907 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.452991 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.453207 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.453327 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.453506 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.453601 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.453800 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.453885 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.454102 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.454190 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.454400 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.454483 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.454719 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.454882 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455050 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455135 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455350 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455434 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455644 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455735 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.455964 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456050 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456280 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456365 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456584 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456681 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456878 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.456971 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.457176 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.457262 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.457473 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.457566 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.457772 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.457855 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458091 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458182 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458383 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458467 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458686 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458769 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.458988 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.459072 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.459288 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.459375 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.459596 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.459680 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.459924 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460013 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460227 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460314 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460538 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460630 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460846 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.460931 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.461149 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.461234 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.461448 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.461532 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.461749 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.461843 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462051 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462137 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462351 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462436 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462663 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462757 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.462964 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463055 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463279 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463417 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463564 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463659 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463884 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.463983 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.464191 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.464274 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.464498 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.464590 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.464803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.465067 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.465151 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.465396 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.465488 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.465694 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.465780 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466000 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466085 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466307 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466405 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466618 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466877 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.466963 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.467213 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.467332 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.467532 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.467625 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.467867 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.467968 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.468173 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.468266 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.468473 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.468603 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.468770 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.468857 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469072 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469158 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469373 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469466 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469670 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469763 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.469966 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.470050 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.470268 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.470352 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.470624 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.470710 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.470921 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471005 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471216 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471308 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471513 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471609 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471839 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.471925 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.472135 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.472233 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.472436 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.472521 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.472730 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.472826 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473029 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473157 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473330 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473448 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473622 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473730 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.473918 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474041 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474212 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474335 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474508 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474592 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474825 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.474918 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.475132 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.475218 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.475432 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.475516 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.475732 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.475839 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476056 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476147 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476357 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476441 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476671 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476757 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.476968 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477060 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477264 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477356 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477558 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477663 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477861 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.477979 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.478161 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.478271 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.478455 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.478543 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.478755 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.478840 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479054 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479151 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479363 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479448 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479662 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479746 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.479981 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480086 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480280 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480365 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480573 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480656 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480878 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.480974 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.481173 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.481258 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.481468 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.481554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.481761 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.481854 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482066 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482150 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482365 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482449 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482660 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482753 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.482961 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483046 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483254 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483346 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483549 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483633 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483865 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.483965 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.484161 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.484247 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.484456 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.484543 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.484757 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.484842 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485053 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485136 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485344 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485429 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485650 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485733 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.485959 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486105 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486282 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486367 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486577 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486670 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486880 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.486977 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.487172 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.487259 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.487468 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.487595 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.487782 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.487882 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488093 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488186 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488395 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488480 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488689 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488782 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.488989 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489073 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489288 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489372 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489586 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489672 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489884 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.489976 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.490185 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.490270 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.490480 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.490565 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.490775 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.490885 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491071 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491156 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491366 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491451 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491661 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491754 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.491995 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492091 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492294 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492379 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492588 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492679 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492888 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.492984 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.493180 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.493265 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.493481 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.493599 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.493818 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.493928 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.494099 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.494183 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.494401 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.494486 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.494706 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.494798 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495006 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495092 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495307 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495391 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495609 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495704 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.495938 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496029 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496235 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496320 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496540 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496637 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496842 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.496927 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.497143 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.497227 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.497437 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.497527 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.497729 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.497813 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498039 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498125 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498340 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498426 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498640 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498731 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.498944 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499027 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499245 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499340 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499543 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499635 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499865 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.499952 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.500170 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.500257 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.500471 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.500565 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.500771 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.500864 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.501069 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.501155 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.501370 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.501454 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.501740 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.501833 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502044 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502135 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502346 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502439 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502649 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502741 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.502947 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503031 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503243 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503335 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503544 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503642 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503873 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.503983 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.504173 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.504270 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.504474 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.504560 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.504773 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.504865 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505067 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505153 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505367 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505455 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505661 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505746 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.505956 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506040 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506248 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506339 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506576 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506662 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506874 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.506959 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.507178 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.507265 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.507477 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.507570 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.507798 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.507901 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.508103 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.508189 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.508414 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.508526 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.508716 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.508815 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.509010 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.509122 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.509423 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.509508 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.509724 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.509821 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510024 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510109 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510324 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510408 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510617 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510715 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.510909 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511003 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511207 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511299 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511519 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511608 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511834 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.511921 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.512131 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.512216 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.512422 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.512524 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.512734 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.512828 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513027 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513119 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513338 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513425 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513682 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513768 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.513986 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.514107 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.514286 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.514395 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.514603 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.514700 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.514902 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.515007 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.515216 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.515311 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.515567 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.515660 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.515901 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516016 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516215 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516309 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516640 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516811 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.516950 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.517110 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.517281 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.517446 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.517603 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.517758 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.517921 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.518056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.518276 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.518398 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.518577 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.518695 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.518888 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519008 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519194 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519325 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519517 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519630 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519860 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.519963 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.520168 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.520356 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.520479 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.520671 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.520780 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.520970 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.521098 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.521283 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.521415 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.521599 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.521724 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.521898 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.522038 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.522195 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.522450 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.522535 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.522770 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.522869 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.523064 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.523150 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.523380 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.523475 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.523677 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.523808 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524005 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524104 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524307 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524403 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524602 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524689 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524897 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.524983 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.525191 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.525276 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.525504 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.525591 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.525796 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.525882 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.526098 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.526183 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.526400 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.526486 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.526704 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.526789 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527004 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527105 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527300 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527384 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527611 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527705 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.527938 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528038 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528235 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528321 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528529 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528624 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528824 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.528919 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.529159 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.529248 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.529454 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.529538 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.529766 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.529861 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530071 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530199 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530370 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530457 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530671 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530766 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.530971 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.531066 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.531292 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.531388 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.531596 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.531682 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.531925 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532014 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532244 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532345 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532538 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532625 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532847 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.532978 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.533174 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.533261 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.533471 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.533559 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.533769 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.533864 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534065 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534163 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534369 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534485 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534664 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534760 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.534954 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535053 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535247 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535334 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535559 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535644 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535878 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.535981 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.536194 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.536287 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.536496 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.536580 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.536791 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.536878 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537085 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537170 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537378 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537464 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537694 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537780 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.537995 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.538123 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.538312 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.538396 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.538610 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.538696 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.538909 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539034 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539213 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539299 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539515 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539602 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539839 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.539937 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.540151 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.540248 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.540456 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.540550 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.540763 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.540849 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541069 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541163 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541371 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541456 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541676 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541773 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.541981 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.542074 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.542289 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.542374 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.542600 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.542798 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.542914 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.543119 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.543227 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.543426 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.543534 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.543735 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.543883 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.544065 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.544176 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.544371 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.544516 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.544677 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.544982 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545069 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545284 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545370 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545588 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545673 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545894 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.545993 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.546204 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.546296 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.546517 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.546602 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.546825 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.546911 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.547137 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.547222 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.547446 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.547545 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.547753 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.547889 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.548082 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.548201 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.548393 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.548515 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.548742 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.549066 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.549742 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.550059 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.550205 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.550372 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.550482 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.550687 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.550773 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.551002 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.551098 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.551355 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.551443 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.551669 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.551754 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552011 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552099 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552318 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552404 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552631 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552716 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.552941 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553027 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553246 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553330 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553550 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553634 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553856 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.553948 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.554164 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.554248 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.554473 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.554603 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.554786 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.554874 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.555095 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.555182 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.555398 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.555491 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.555707 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.555821 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.556064 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.556149 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.556387 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.556610 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.556698 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.556921 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.557008 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.557249 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.557334 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.557567 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.557798 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.557884 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.558112 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.558197 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.558443 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.558532 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.558764 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.558850 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.559071 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.559156 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.559370 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.559456 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.559675 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.559760 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560025 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560127 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560328 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560423 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560627 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560713 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.560937 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561031 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561245 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561338 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561547 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561633 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561870 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.561963 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.562179 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.562398 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.562493 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.562739 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.562824 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.563047 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.563175 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.563365 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.563592 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.563689 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.563969 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.564124 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.564339 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.564426 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.564656 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.564742 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.564958 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565045 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565259 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565345 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565567 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565703 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565872 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.565958 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.566168 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.566252 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.566467 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.566560 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.566770 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.566857 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567075 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567160 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567372 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567671 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567756 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.567997 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568081 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568305 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568434 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568603 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568696 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568902 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.568988 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.569198 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.569292 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.569501 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.569620 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.569799 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.569887 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570095 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570189 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570391 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570489 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570689 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570782 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.570989 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571081 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571280 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571365 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571578 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571669 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571898 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.571986 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.572203 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.572288 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.572500 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.572587 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.572801 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.572888 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.573096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.573170 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.573400 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.573485 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.573698 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.573783 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574001 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574086 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574305 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574440 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574628 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574716 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.574930 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575019 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575233 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575333 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575535 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575621 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575894 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.575999 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.576205 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.576304 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.576523 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.576731 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.576818 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.577059 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.577144 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.577375 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.577468 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.577698 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.577977 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578070 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578306 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578404 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578604 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578690 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578900 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.578985 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.579218 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.579311 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.579523 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.579611 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.579873 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.579978 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.580177 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.580270 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.580483 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.580568 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.580790 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.580876 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.581095 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.581182 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.581400 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.581492 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.581703 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.581863 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582006 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582091 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582307 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582399 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582608 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582703 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582912 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.582997 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.583213 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.583296 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.583513 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.583619 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.583842 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.583929 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.584152 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.584239 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.584459 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.584559 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.584765 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.584851 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585071 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585158 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585377 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585464 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585681 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585766 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.585982 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586067 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586280 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586374 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586582 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586677 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586887 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.586972 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.587190 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.587275 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.587497 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.587583 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.587814 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.587914 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.588127 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.588212 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.588452 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.588538 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.588765 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.588862 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.589066 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.589151 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.589399 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.589485 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.589713 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.589807 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590028 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590123 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590333 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590418 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590652 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590738 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.590954 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.591039 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.591277 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.591362 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.591583 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.591668 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.591928 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592028 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592241 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592333 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592538 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592624 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592835 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.592924 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.593131 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.593230 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.593434 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.593523 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.593742 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.593828 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594043 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594136 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594337 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594423 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594633 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594719 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.594933 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595023 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595227 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595337 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595568 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595659 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595893 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.595994 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.596190 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.596274 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.596491 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.596576 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.596787 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.596873 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597080 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597164 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597373 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597667 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597762 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.597962 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598055 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598255 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598353 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598552 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598637 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598843 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.598929 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.599138 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.599223 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.599431 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.599518 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.599726 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.599853 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600042 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600140 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600339 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600423 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600640 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600725 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.600940 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601039 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601238 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601324 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601563 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601647 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601876 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.601971 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.602180 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.602275 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.602496 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.602580 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.602801 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.602928 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.603108 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.603193 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.603410 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.603494 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.603726 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.603832 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604057 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604142 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604368 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604454 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604672 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604757 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.604979 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605065 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605286 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605375 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605591 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605676 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605899 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.605985 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.606212 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.606306 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.606509 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.606593 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.606818 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.606901 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.607132 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.607230 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.607448 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.607579 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.607748 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.607879 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.608072 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.608171 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.608392 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.608477 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.608696 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.608781 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609000 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609093 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609304 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609392 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609608 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609706 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609911 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.609998 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.610215 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.610298 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.610523 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.610616 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.610824 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.610910 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.611155 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.611241 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.611463 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.611557 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.611834 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.611935 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.612101 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.612188 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.612406 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.612509 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.612721 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.612805 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613038 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613129 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613358 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613451 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613669 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613758 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.613995 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.614080 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.614313 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.614406 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.614619 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.614706 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.614925 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.615009 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.615224 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.615310 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.615461 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 05:04:32.615592 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.615931 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.616251 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.616556 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:04:32.616799 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 05:04:32.770537 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO dbcounter [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Registered counter for database nova_api Aug 05 05:04:32.773132 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO dbcounter [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Registered counter for database nova_api Aug 05 05:04:32.790734 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_db.sqlalchemy.engines [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:32.792839 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_db.sqlalchemy.engines [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:32.799939 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writer thread running {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:32.800212 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writer thread running {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:32.854499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.context [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d40b831a-f22f-4ca8-ad5d-c9bb9a692e13(cell1) {{(pid=103386) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 05:04:32.854869 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.context [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d40b831a-f22f-4ca8-ad5d-c9bb9a692e13(cell1) {{(pid=103385) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 05:04:32.858416 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:04:32.858697 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_concurrency.lockutils [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:04:32.858911 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:04:32.859166 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_concurrency.lockutils [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:04:32.860491 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:04:32.860766 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_concurrency.lockutils [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:04:32.861253 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:04:32.861495 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_concurrency.lockutils [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:04:32.861669 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:04:32.861991 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_concurrency.lockutils [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:04:32.863687 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:04:32.863974 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_concurrency.lockutils [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:04:32.865682 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO dbcounter [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Registered counter for database nova_cell0 Aug 05 05:04:32.866002 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO dbcounter [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Registered counter for database nova_cell0 Aug 05 05:04:32.871311 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO dbcounter [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Registered counter for database nova_cell1 Aug 05 05:04:32.871455 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO dbcounter [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Registered counter for database nova_cell1 Aug 05 05:04:32.879079 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_db.sqlalchemy.engines [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:32.880768 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_db.sqlalchemy.engines [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:32.885270 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writer thread running {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:32.885904 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_db.sqlalchemy.engines [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:32.886972 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_db.sqlalchemy.engines [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:32.887627 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writer thread running {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:33.023692 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writer thread running {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:33.025909 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writer thread running {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:33.032583 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO dbcounter [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Registered counter for database nova_cell0 Aug 05 05:04:33.034699 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO dbcounter [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Registered counter for database nova_cell0 Aug 05 05:04:33.042437 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG oslo_db.sqlalchemy.engines [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:33.045462 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_db.sqlalchemy.engines [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:04:33.047924 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writer thread running {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:33.051048 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writer thread running {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:04:33.380089 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: WARNING keystonemiddleware.auth_token [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:04:33.383390 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: WARNING keystonemiddleware.auth_token [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:04:33.387303 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: WARNING keystonemiddleware.auth_token [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:04:33.390626 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: WARNING keystonemiddleware.auth_token [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:04:33.728018 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: WARNING keystonemiddleware.auth_token [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:04:33.732473 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: WARNING keystonemiddleware.auth_token [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:04:33.734076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: WARNING keystonemiddleware.auth_token [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:04:33.738454 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: WARNING keystonemiddleware.auth_token [None req-ad520539-fb72-4bd9-812d-9ee9c0a93100 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:04:33.739416 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abef4d79c0 pid: 103386 (default app) Aug 05 05:04:33.741508 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:04:33.742681 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Aug 05 05:04:33.743407 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Fri Aug 5 05:04:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:04:33.743744 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abef4d79c0 pid: 103385 (default app) Aug 05 05:05:49.152663 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:05:49.153688 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 05 05:05:49.154078 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:05:49.166227 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writing DB stats nova_api:SELECT=3 {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:49.167169 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writing DB stats nova_cell0:SELECT=3 {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:49.168527 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writing DB stats nova_cell1:SELECT=3 {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:49.169358 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:50.034668 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-28022220-3683-4a77-a97e-70515992cb37 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:05:50.068137 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-28022220-3683-4a77-a97e-70515992cb37 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906955 Aug 05 05:05:50.068985 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Aug 5 05:05:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:05:52.226141 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:05:52.226686 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-d1df25d2-c617-4a51-ada0-22aeba784486 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 05 05:05:52.227256 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:05:52.684254 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-15c83454-39ab-411a-88c9-3dbbdcf05569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:05:52.704220 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:05:52.704220 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: warnings.warn(msg) Aug 05 05:05:52.731745 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-15c83454-39ab-411a-88c9-3dbbdcf05569 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498224 Aug 05 05:05:52.732544 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:05:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:05:52.745896 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_api:SELECT=3 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:52.746972 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_cell1:SELECT=3 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:52.747800 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_cell0:SELECT=3 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:52.748556 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:05:52.951984 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-a1423ee9-c969-4e90-ae13-726999382559 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:05:52.956350 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:05:52.956350 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: warnings.warn(msg) Aug 05 05:05:53.030073 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-a1423ee9-c969-4e90-ae13-726999382559 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289077 Aug 05 05:05:53.031502 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Aug 5 05:05:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:05:55.271685 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-15c83454-39ab-411a-88c9-3dbbdcf05569 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:05:55.272993 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-15c83454-39ab-411a-88c9-3dbbdcf05569 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001773 Aug 05 05:05:55.274085 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:05:55.954004 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-1297b158-6a17-4c03-83b3-a483f7425ff2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:05:55.972857 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:05:55.972857 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: warnings.warn(msg) Aug 05 05:05:55.993351 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-1297b158-6a17-4c03-83b3-a483f7425ff2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712662 Aug 05 05:05:55.994558 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:05:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:05:56.006315 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-b74b3d4d-8665-49b2-ac4b-663f45af3fcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:05:56.009426 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:05:56.009426 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: warnings.warn(msg) Aug 05 05:05:56.044793 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-b74b3d4d-8665-49b2-ac4b-663f45af3fcf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042137 Aug 05 05:05:56.045678 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Aug 5 05:05:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:05:58.225004 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-1297b158-6a17-4c03-83b3-a483f7425ff2 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:05:58.226371 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-1297b158-6a17-4c03-83b3-a483f7425ff2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 05 05:05:58.228037 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:05:58.643674 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-8c6ff7c1-c8d7-423b-9706-f4f1734e6fdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "name": "ds1G", "disk": 10, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:05:58.663450 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-8c6ff7c1-c8d7-423b-9706-f4f1734e6fdd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431255 Aug 05 05:05:58.664274 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:05:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 05:05:58.676679 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-7e576b1c-d023-4bf3-8cfd-0567845e214d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:05:58.701782 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-7e576b1c-d023-4bf3-8cfd-0567845e214d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029158 Aug 05 05:05:58.702791 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Aug 5 05:05:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:06:00.876632 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-8c6ff7c1-c8d7-423b-9706-f4f1734e6fdd admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:00.877645 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-8c6ff7c1-c8d7-423b-9706-f4f1734e6fdd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Aug 05 05:06:00.878058 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:01.318945 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-79c69896-25d6-4bea-b360-81988600a86d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:01.339609 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-79c69896-25d6-4bea-b360-81988600a86d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455117 Aug 05 05:06:01.339609 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:01.351720 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-93f40699-7e4a-4c63-86e0-40c5b44f36ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:01.385010 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-93f40699-7e4a-4c63-86e0-40c5b44f36ea admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036960 Aug 05 05:06:01.385574 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Aug 5 05:06:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:06:03.588205 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-79c69896-25d6-4bea-b360-81988600a86d admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:03.589237 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-79c69896-25d6-4bea-b360-81988600a86d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 05 05:06:03.589605 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:04.000610 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-3a2e9be4-f422-4d23-baf9-4dd2dc013eaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G"}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:04.024769 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-3a2e9be4-f422-4d23-baf9-4dd2dc013eaa admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428744 Aug 05 05:06:04.026105 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 05:06:04.037999 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-c5b7081f-20e1-4ef7-9a9a-2885a480f4f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:04.062880 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-c5b7081f-20e1-4ef7-9a9a-2885a480f4f1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028605 Aug 05 05:06:04.063864 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Fri Aug 5 05:06:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:06:06.273860 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-3a2e9be4-f422-4d23-baf9-4dd2dc013eaa admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:06.274891 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-3a2e9be4-f422-4d23-baf9-4dd2dc013eaa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Aug 05 05:06:06.275374 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:06.748657 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-a38f32da-c28e-4484-ad88-c237f1362d75 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:06.774717 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-a38f32da-c28e-4484-ad88-c237f1362d75 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.492423 Aug 05 05:06:06.775294 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Aug 5 05:06:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:09.004152 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-3a2e9be4-f422-4d23-baf9-4dd2dc013eaa admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:09.005245 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-3a2e9be4-f422-4d23-baf9-4dd2dc013eaa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Aug 05 05:06:09.005681 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:09.451004 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-94607fb9-26fd-42ad-a1ee-ad7ad8187eb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "1", "disk": 1, "name": "m1.tiny"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:09.470864 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-94607fb9-26fd-42ad-a1ee-ad7ad8187eb7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.458603 Aug 05 05:06:09.471520 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:09.484433 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-f781839c-f7f2-4155-83cc-ca63b827ec47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:09.511064 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-f781839c-f7f2-4155-83cc-ca63b827ec47 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030512 Aug 05 05:06:09.511682 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Aug 5 05:06:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:06:12.054972 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-94607fb9-26fd-42ad-a1ee-ad7ad8187eb7 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:12.056033 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-94607fb9-26fd-42ad-a1ee-ad7ad8187eb7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 05 05:06:12.056437 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:12.455453 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-b6055a0b-9422-47a0-beff-cf53474a322c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:12.475210 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-b6055a0b-9422-47a0-beff-cf53474a322c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412186 Aug 05 05:06:12.475690 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:12.487745 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-90d268c9-304d-45a6-b68b-f410cddca294 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:12.513899 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-90d268c9-304d-45a6-b68b-f410cddca294 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029805 Aug 05 05:06:12.514759 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Aug 5 05:06:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:06:14.676972 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-b6055a0b-9422-47a0-beff-cf53474a322c admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:14.678072 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-b6055a0b-9422-47a0-beff-cf53474a322c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 05 05:06:14.678473 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:15.047886 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-a9b6be69-174d-424e-a983-1a0dcbbd6e27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:15.068159 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-a9b6be69-174d-424e-a983-1a0dcbbd6e27 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.383037 Aug 05 05:06:15.068732 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 05:06:15.080996 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-d2ca1dab-b938-4e6f-9846-bb193b1963d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:15.105253 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-d2ca1dab-b938-4e6f-9846-bb193b1963d8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028036 Aug 05 05:06:15.105820 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Aug 5 05:06:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:06:17.372348 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-a9b6be69-174d-424e-a983-1a0dcbbd6e27 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:17.373368 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-a9b6be69-174d-424e-a983-1a0dcbbd6e27 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 05 05:06:17.373768 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:17.810250 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-b400c10a-cffb-4b6f-83c6-72c01e7ecf21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "id": "4", "vcpus": 4, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:17.833035 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-b400c10a-cffb-4b6f-83c6-72c01e7ecf21 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453033 Aug 05 05:06:17.836130 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:17.845769 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-7b1fbaee-2761-4833-955c-34813a5cc660 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:17.873222 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-7b1fbaee-2761-4833-955c-34813a5cc660 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031182 Aug 05 05:06:17.873937 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Aug 5 05:06:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:06:20.041475 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-b400c10a-cffb-4b6f-83c6-72c01e7ecf21 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:20.042714 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-b400c10a-cffb-4b6f-83c6-72c01e7ecf21 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Aug 05 05:06:20.043183 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:20.535752 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-f0d8ed79-8bb4-43b6-92cc-4027a9be38e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:20.556356 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-f0d8ed79-8bb4-43b6-92cc-4027a9be38e3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.506760 Aug 05 05:06:20.556921 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Fri Aug 5 05:06:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:20.569315 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-217a4e01-ccf5-446f-9a0c-13a4336e6541 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:20.574589 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:20.596750 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-217a4e01-ccf5-446f-9a0c-13a4336e6541 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031209 Aug 05 05:06:20.597326 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Fri Aug 5 05:06:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:06:40.382376 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-f0d8ed79-8bb4-43b6-92cc-4027a9be38e3 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:40.383397 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-f0d8ed79-8bb4-43b6-92cc-4027a9be38e3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 05 05:06:40.383797 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:40.798843 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-a30cb269-faa8-43d9-a163-101061508b2f admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:40.816949 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-a30cb269-faa8-43d9-a163-101061508b2f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426969 Aug 05 05:06:40.817403 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Aug 5 05:06:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:41.896036 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-f0d8ed79-8bb4-43b6-92cc-4027a9be38e3 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:41.897049 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-f0d8ed79-8bb4-43b6-92cc-4027a9be38e3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 05 05:06:41.897413 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:42.437524 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-f0262b69-08dc-4fbf-8475-d633244ed4a4 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:42.443359 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.wsgi [None req-f0262b69-08dc-4fbf-8475-d633244ed4a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-f0262b69-08dc-4fbf-8475-d633244ed4a4 admin admin] Request method failure captured: Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Accept: application/json Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Accept-Encoding: gzip, deflate Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Connection: keep-alive Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Content-Length: 0 Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Host: 10.222.0.30 Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Openstack-Api-Version: compute 2.90 Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Openstack-System-Scope: None Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: User-Agent: python-novaclient Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Auth-Token: gAAAAABi7KVhiluBBhwjIFfsOUeeCJS9agjSCS7QlqjKXdcgT98kiclWiIyW50C_P43A5Cel3_u7FliOaaBSmZiisxJF--0MBm21yaQUZ6Z2pwOClnQTbFHiRJ0mev_17WcxfTQHqCW9RYPGBUpPqie1gH4YT_3Wu5q7gcoxk4O6cLCqv5kAezM Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Domain-Id: None Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Domain-Name: None Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Identity-Status: Confirmed Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Is-Admin-Project: True Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Domain-Id: default Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Domain-Name: Default Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Name: admin Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Role: admin,reader,member Aug 05 05:06:42.446723 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Roles: admin,reader,member Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ea26c15401c49d28fd797d4ee85aa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant: admin Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant-Name: admin Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User: admin Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Domain-Id: default Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Domain-Name: Default Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Id: c8b08b7805764c45aae169c453594d3d Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Name: admin Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: method: > Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: exception: Flavor 42 could not be found. Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: action_args: {'id': '42'} Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:06:42.448421 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:42.449444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.450779 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-f0262b69-08dc-4fbf-8475-d633244ed4a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:06:42.452180 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-f0262b69-08dc-4fbf-8475-d633244ed4a4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.414320 Aug 05 05:06:42.452180 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Aug 5 05:06:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 05:06:42.458145 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-6d063c8d-d6c4-4e03-9f02-257a2a8800e9 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:42.462460 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:06:42.481535 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-6d063c8d-d6c4-4e03-9f02-257a2a8800e9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026943 Aug 05 05:06:42.482090 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Aug 5 05:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:42.492299 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-8c781023-3190-4eb7-adb3-c7dece9192d1 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:42.516351 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-8c781023-3190-4eb7-adb3-c7dece9192d1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027723 Aug 05 05:06:42.516891 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Aug 5 05:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:42.526528 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-c801a108-2912-4834-bae9-5b112b3240f5 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:42.533103 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.wsgi [None req-c801a108-2912-4834-bae9-5b112b3240f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-c801a108-2912-4834-bae9-5b112b3240f5 admin admin] Request method failure captured: Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Accept: application/json Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Accept-Encoding: gzip, deflate Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Connection: keep-alive Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Content-Length: 0 Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Host: 10.222.0.30 Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Openstack-Api-Version: compute 2.90 Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Openstack-System-Scope: None Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: User-Agent: python-novaclient Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Auth-Token: gAAAAABi7KVhiluBBhwjIFfsOUeeCJS9agjSCS7QlqjKXdcgT98kiclWiIyW50C_P43A5Cel3_u7FliOaaBSmZiisxJF--0MBm21yaQUZ6Z2pwOClnQTbFHiRJ0mev_17WcxfTQHqCW9RYPGBUpPqie1gH4YT_3Wu5q7gcoxk4O6cLCqv5kAezM Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Domain-Id: None Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Domain-Name: None Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Identity-Status: Confirmed Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Is-Admin-Project: True Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Domain-Id: default Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Domain-Name: Default Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Name: admin Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Role: admin,reader,member Aug 05 05:06:42.536546 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Roles: admin,reader,member Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ea26c15401c49d28fd797d4ee85aa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant: admin Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant-Name: admin Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User: admin Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Domain-Id: default Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Domain-Name: Default Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Id: c8b08b7805764c45aae169c453594d3d Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Name: admin Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: method: > Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: exception: Flavor 42 could not be found. Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: action_args: {'id': '42'} Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:06:42.538076 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:42.539056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:42.540362 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-c801a108-2912-4834-bae9-5b112b3240f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:06:42.541590 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-c801a108-2912-4834-bae9-5b112b3240f5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015019 Aug 05 05:06:42.541590 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Aug 5 05:06:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 05:06:43.518682 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-8c781023-3190-4eb7-adb3-c7dece9192d1 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:43.519701 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-8c781023-3190-4eb7-adb3-c7dece9192d1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Aug 05 05:06:43.520134 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:44.108405 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-f1272c60-0d24-4b5c-92ed-0e0c6c2c6106 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:44.114528 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.wsgi [None req-f1272c60-0d24-4b5c-92ed-0e0c6c2c6106 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-f1272c60-0d24-4b5c-92ed-0e0c6c2c6106 admin admin] Request method failure captured: Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Accept: application/json Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Accept-Encoding: gzip, deflate Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Connection: keep-alive Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Content-Length: 0 Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Host: 10.222.0.30 Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Openstack-Api-Version: compute 2.90 Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Openstack-System-Scope: None Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: User-Agent: python-novaclient Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Auth-Token: gAAAAABi7KVjD_KyIYd03xbM2qHCcnr3l7DB1eFc8PbJLcNDgBIPJ5G4XeemqiGz721EjoMagAia3GoHEY3AQ5Cr4cuE37XZiUkdVF58ymzvfZ9NnrNj-V3pXZ0o7OsMMjSvF-PGpr8qG7q8588YawoL8xEMlTXwta8S5Ujr1oa6rud8y-67iVQ Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Domain-Id: None Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Domain-Name: None Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Identity-Status: Confirmed Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Is-Admin-Project: True Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Domain-Id: default Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Domain-Name: Default Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Name: admin Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Role: admin,reader,member Aug 05 05:06:44.116096 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Roles: admin,reader,member Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ea26c15401c49d28fd797d4ee85aa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant: admin Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant-Name: admin Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User: admin Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Domain-Id: default Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Domain-Name: Default Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Id: c8b08b7805764c45aae169c453594d3d Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Name: admin Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: method: > Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: exception: Flavor 84 could not be found. Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: action_args: {'id': '84'} Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:06:44.117554 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:44.118499 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.119941 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-f1272c60-0d24-4b5c-92ed-0e0c6c2c6106 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:06:44.121153 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-f1272c60-0d24-4b5c-92ed-0e0c6c2c6106 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.459097 Aug 05 05:06:44.121153 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Aug 5 05:06:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 05:06:44.129742 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-458d8683-0a4c-4236-81ac-810d87e211b8 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:44.148299 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-458d8683-0a4c-4236-81ac-810d87e211b8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024259 Aug 05 05:06:44.148813 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Aug 5 05:06:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:06:44.158790 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-2e4de96a-9c92-4ecd-af0f-c130f4f96427 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:44.174472 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-2e4de96a-9c92-4ecd-af0f-c130f4f96427 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019132 Aug 05 05:06:44.174989 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Aug 5 05:06:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:44.184367 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-3c461287-2800-48bc-a85f-c243b441aa1d admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:44.190053 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.wsgi [None req-3c461287-2800-48bc-a85f-c243b441aa1d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-3c461287-2800-48bc-a85f-c243b441aa1d admin admin] Request method failure captured: Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Accept: application/json Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Accept-Encoding: gzip, deflate Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Connection: keep-alive Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Content-Length: 0 Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Host: 10.222.0.30 Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Openstack-Api-Version: compute 2.90 Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Openstack-System-Scope: None Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: User-Agent: python-novaclient Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Auth-Token: gAAAAABi7KVjD_KyIYd03xbM2qHCcnr3l7DB1eFc8PbJLcNDgBIPJ5G4XeemqiGz721EjoMagAia3GoHEY3AQ5Cr4cuE37XZiUkdVF58ymzvfZ9NnrNj-V3pXZ0o7OsMMjSvF-PGpr8qG7q8588YawoL8xEMlTXwta8S5Ujr1oa6rud8y-67iVQ Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Domain-Id: None Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Domain-Name: None Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Identity-Status: Confirmed Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Is-Admin-Project: True Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Domain-Id: default Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Domain-Name: Default Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Name: admin Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Role: admin,reader,member Aug 05 05:06:44.191572 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Roles: admin,reader,member Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ea26c15401c49d28fd797d4ee85aa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant: admin Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant-Name: admin Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User: admin Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Domain-Id: default Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Domain-Name: Default Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Id: c8b08b7805764c45aae169c453594d3d Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Name: admin Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: method: > Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: exception: Flavor 84 could not be found. Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: action_args: {'id': '84'} Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:06:44.193106 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:44.194082 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:44.195457 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-3c461287-2800-48bc-a85f-c243b441aa1d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:06:44.196836 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-3c461287-2800-48bc-a85f-c243b441aa1d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012158 Aug 05 05:06:44.196836 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Fri Aug 5 05:06:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 05:06:45.167224 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-2e4de96a-9c92-4ecd-af0f-c130f4f96427 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:45.168476 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-2e4de96a-9c92-4ecd-af0f-c130f4f96427 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 Aug 05 05:06:45.169002 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:45.708712 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-0f9d23d9-67fd-43d8-9aec-cc1e059fd3d0 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:45.714484 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.wsgi [None req-0f9d23d9-67fd-43d8-9aec-cc1e059fd3d0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-0f9d23d9-67fd-43d8-9aec-cc1e059fd3d0 admin admin] Request method failure captured: Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Accept: application/json Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Accept-Encoding: gzip, deflate Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Connection: keep-alive Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Content-Length: 0 Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Host: 10.222.0.30 Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Openstack-Api-Version: compute 2.90 Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Openstack-System-Scope: None Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: User-Agent: python-novaclient Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Auth-Token: gAAAAABi7KVlt8jBJNNMTTrSVYOe_YgcTzmi677rHskstdNPLZsQKjDuiUjevR8-iHZtVKM0yXewShh245_KZwZzPn5kHFXkTDw6hljwlw0w7PEbKxrb7lx8Ic79Kp5w3Jb9gbANmRvV3JcMXW3n6mhF2Z8XB1FzaLR0TcZEYb7i0xSc2i1ZekY Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Domain-Id: None Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Domain-Name: None Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Identity-Status: Confirmed Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Is-Admin-Project: True Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Domain-Id: default Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Domain-Name: Default Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Project-Name: admin Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Role: admin,reader,member Aug 05 05:06:45.716012 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Roles: admin,reader,member Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ea26c15401c49d28fd797d4ee85aa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant: admin Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-Tenant-Name: admin Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User: admin Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Domain-Id: default Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Domain-Name: Default Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Id: c8b08b7805764c45aae169c453594d3d Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: X-User-Name: admin Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: method: > Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: exception: Flavor 451 could not be found. Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: action_args: {'id': '451'} Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:06:45.717554 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:45.718482 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.719803 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-0f9d23d9-67fd-43d8-9aec-cc1e059fd3d0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:06:45.721059 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-0f9d23d9-67fd-43d8-9aec-cc1e059fd3d0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.409254 Aug 05 05:06:45.721059 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Aug 5 05:06:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 05:06:45.729976 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-a89a8600-52f4-48b7-a3c7-ae91a34f655a admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:45.747577 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-a89a8600-52f4-48b7-a3c7-ae91a34f655a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023590 Aug 05 05:06:45.748119 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Aug 5 05:06:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:45.757652 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:45.772533 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018378 Aug 05 05:06:45.773076 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Fri Aug 5 05:06:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:06:45.782483 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-4e7575bf-4e7d-49d7-8b69-fa8803b56113 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:45.788106 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.wsgi [None req-4e7575bf-4e7d-49d7-8b69-fa8803b56113 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-4e7575bf-4e7d-49d7-8b69-fa8803b56113 admin admin] Request method failure captured: Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Accept: application/json Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Accept-Encoding: gzip, deflate Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Connection: keep-alive Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Content-Length: 0 Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Host: 10.222.0.30 Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Openstack-Api-Version: compute 2.90 Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Openstack-System-Scope: None Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: User-Agent: python-novaclient Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Auth-Token: gAAAAABi7KVlt8jBJNNMTTrSVYOe_YgcTzmi677rHskstdNPLZsQKjDuiUjevR8-iHZtVKM0yXewShh245_KZwZzPn5kHFXkTDw6hljwlw0w7PEbKxrb7lx8Ic79Kp5w3Jb9gbANmRvV3JcMXW3n6mhF2Z8XB1FzaLR0TcZEYb7i0xSc2i1ZekY Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Domain-Id: None Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Domain-Name: None Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Identity-Status: Confirmed Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Is-Admin-Project: True Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Domain-Id: default Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Domain-Name: Default Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Project-Name: admin Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Role: admin,reader,member Aug 05 05:06:45.789594 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Roles: admin,reader,member Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ea26c15401c49d28fd797d4ee85aa6c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ea26c15401c49d28fd797d4ee85aa6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant: admin Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant-Id: 4ea26c15401c49d28fd797d4ee85aa6c Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-Tenant-Name: admin Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User: admin Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Domain-Id: default Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Domain-Name: Default Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Id: c8b08b7805764c45aae169c453594d3d Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: X-User-Name: admin Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: method: > Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: exception: Flavor 451 could not be found. Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: action_args: {'id': '451'} Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:06:45.791160 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:45.792137 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: ERROR nova.api.openstack.wsgi Aug 05 05:06:45.793510 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-4e7575bf-4e7d-49d7-8b69-fa8803b56113 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:06:45.794744 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-4e7575bf-4e7d-49d7-8b69-fa8803b56113 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012024 Aug 05 05:06:45.794744 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Aug 5 05:06:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 05:06:46.758699 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:46.759719 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 05 05:06:46.760158 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:47.314056 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-8ed8d35d-1108-4102-99e0-7b80bf4034ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:47.337783 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-8ed8d35d-1108-4102-99e0-7b80bf4034ab admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.441692 Aug 05 05:06:47.338360 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Aug 5 05:06:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:48.300946 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:48.301982 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 05 05:06:48.302377 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:48.854951 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-b10382c0-0d73-4e42-81be-a73a7748615a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:48.875368 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-b10382c0-0d73-4e42-81be-a73a7748615a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.435678 Aug 05 05:06:48.875855 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Aug 5 05:06:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:49.854729 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:49.855737 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 05 05:06:49.856165 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:50.410639 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-6b69517d-6968-447e-80b0-9dbaa582d707 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:50.435330 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-6b69517d-6968-447e-80b0-9dbaa582d707 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.442588 Aug 05 05:06:50.435856 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Aug 5 05:06:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:51.400434 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:51.401475 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 05 05:06:51.401865 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:06:51.953788 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-5daffc28-0362-4dad-8818-1c33ed8211da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:06:51.975063 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-5daffc28-0362-4dad-8818-1c33ed8211da admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.435581 Aug 05 05:06:51.975661 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Fri Aug 5 05:06:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:06:52.972535 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:52.973548 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 05 05:06:52.973950 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:06:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:06:53.561999 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-1a0382a5-aac5-4857-8386-44c015f53980 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:06:53.583605 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-1a0382a5-aac5-4857-8386-44c015f53980 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.473486 Aug 05 05:06:53.584169 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Fri Aug 5 05:06:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:07:44.775831 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:07:44.776837 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-03b59fa0-c9b4-4b26-8d91-0b0ededf8180 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 05 05:07:44.777257 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Fri Aug 5 05:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:07:44.791357 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:45.196274 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-313cbf6d-d950-4927-9376-563b775e16ed admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:07:45.219677 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-313cbf6d-d950-4927-9376-563b775e16ed admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435940 Aug 05 05:07:45.220322 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Fri Aug 5 05:07:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:07:45.244244 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-bee51f84-87e3-4641-8362-e6b1a4bfe16d admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:07:45.247713 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG dbcounter [-] [103385] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:07:45.253921 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-bee51f84-87e3-4641-8362-e6b1a4bfe16d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013412 Aug 05 05:07:45.254387 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Fri Aug 5 05:07:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:07:45.266370 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-4d7f4730-5e43-438d-a147-c7e318b6bb83 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:07:45.274606 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-4d7f4730-5e43-438d-a147-c7e318b6bb83 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011863 Aug 05 05:07:45.275124 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Fri Aug 5 05:07:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:07:45.286763 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:07:45.297054 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013557 Aug 05 05:07:45.297605 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Fri Aug 5 05:07:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:07:45.309738 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-d243bc8d-70d5-45ed-af66-7f320a1c549f admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:07:45.317619 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-d243bc8d-70d5-45ed-af66-7f320a1c549f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011692 Aug 05 05:07:45.318128 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Fri Aug 5 05:07:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:11:09.532846 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:09.533910 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 05 05:11:09.534331 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:11:09.672143 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_api:SELECT=6 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:11:09.848879 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:09.851815 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:11:09.851815 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: warnings.warn(msg) Aug 05 05:11:09.852921 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:09.853388 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:09.853844 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:09.854521 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:09.854951 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:09.855406 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:09.888292 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-cf8e6d04-ce3c-4777-9d2c-eb604b59c859 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.217542 Aug 05 05:11:09.888837 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Aug 5 05:11:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:11:10.709791 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:10.710819 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 05 05:11:10.711215 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:11:10.899668 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:10.902398 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:11:10.902398 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: warnings.warn(msg) Aug 05 05:11:10.903505 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:10.904007 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:10.904427 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:10.905138 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:10.905573 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:10.905982 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:10.925420 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-6db1bcc0-e446-46d7-b94d-e7b108f5da88 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075904 Aug 05 05:11:10.926268 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Aug 5 05:11:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:11:22.270073 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:22.271083 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 05 05:11:22.271444 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:11:22.414877 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_cell0:SELECT=4 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:11:22.415821 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_cell1:SELECT=4 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:11:22.416693 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG dbcounter [-] [103386] Writing DB stats nova_api:SELECT=8 {{(pid=103386) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:11:22.470133 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:22.472521 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:11:22.472521 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: warnings.warn(msg) Aug 05 05:11:22.473616 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:22.474085 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:22.474504 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:22.475210 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:22.475647 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:22.476092 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:22.500471 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-3040e55a-ac17-4813-982a-5aa4c1e6fa5c admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.092846 Aug 05 05:11:22.501248 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Aug 5 05:11:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:11:23.324149 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: DEBUG nova.api.openstack.wsgi [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] Calling method '>' {{(pid=103385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:23.325409 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: INFO nova.api.openstack.requestlog [None req-68388b74-b805-467d-95fa-520b23393840 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Aug 05 05:11:23.325919 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: [pid: 103385|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Fri Aug 5 05:11:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:11:23.518377 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG nova.api.openstack.wsgi [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Calling method '>' {{(pid=103386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:11:23.520777 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 05:11:23.520777 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: warnings.warn(msg) Aug 05 05:11:23.521918 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:23.522387 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:23.522802 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:23.523570 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:11:23.523970 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:11:23.524379 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: DEBUG oslo_concurrency.lockutils [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:11:23.546154 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: INFO nova.api.openstack.requestlog [None req-b71da21b-ec5e-4178-a11d-f85bc1e682ea admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083372 Aug 05 05:11:23.546666 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: [pid: 103386|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Fri Aug 5 05:11:23 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:12:19.112618 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: Fri Aug 5 05:12:19 2022 - graceful shutdown triggered... Aug 05 05:12:19.112738 dv-cinder-815582-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 05:12:19.114068 dv-cinder-815582-14-iscsi devstack@n-api.service[103386]: Gracefully killing worker 2 (pid: 103386)... Aug 05 05:12:19.114539 dv-cinder-815582-14-iscsi devstack@n-api.service[103385]: Gracefully killing worker 1 (pid: 103385)... Aug 05 05:12:20.114721 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: worker 1 buried after 1 seconds Aug 05 05:12:20.114721 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: worker 2 buried after 1 seconds Aug 05 05:12:20.114721 dv-cinder-815582-14-iscsi devstack@n-api.service[103384]: goodbye to uWSGI. Aug 05 05:12:20.117261 dv-cinder-815582-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 05:12:20.118153 dv-cinder-815582-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 05:12:20.122641 dv-cinder-815582-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 05:12:20.136561 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 05:12:20 2022] *** Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: nodename: dv-cinder-815582-14-iscsi Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: machine: x86_64 Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: clock source: unix Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: pcre jit disabled Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: detected number of CPU cores: 4 Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: current working directory: / Aug 05 05:12:20.139203 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: detected binary path: /usr/bin/uwsgi-core Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: your processes number limit is 47680 Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: your memory page size is 4096 bytes Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: detected max file descriptor number: 2048 Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: lock engine: pthread robust mutexes Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: thunder lock: enabled Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 05:12:20.140076 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 05:12:20.179213 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: Python main interpreter initialized at 0x560c15c1d9c0 Aug 05 05:12:20.179213 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: python threads support enabled Aug 05 05:12:20.179213 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: your server socket listen backlog is limited to 100 connections Aug 05 05:12:20.179213 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: your mercy for graceful operations on workers is 90 seconds Aug 05 05:12:20.179666 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 05:12:20.179666 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: *** Operational MODE: preforking *** Aug 05 05:12:20.179971 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: *** uWSGI is running in multiple interpreter mode *** Aug 05 05:12:20.179971 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: spawned uWSGI master process (pid: 117885) Aug 05 05:12:20.180191 dv-cinder-815582-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 05:12:20.180754 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: spawned uWSGI worker 1 (pid: 117902, cores: 1) Aug 05 05:12:20.181285 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: spawned uWSGI worker 2 (pid: 117903, cores: 1) Aug 05 05:12:20.181554 dv-cinder-815582-14-iscsi devstack@n-api.service[117885]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 05:12:20.827865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 05:12:20.838226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 05:12:21.958567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:12:21.958567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: from cryptography.utils import int_from_bytes Aug 05 05:12:21.959084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:12:21.959084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: from cryptography.utils import int_from_bytes Aug 05 05:12:21.963073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:12:21.963073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: from cryptography.utils import int_from_bytes Aug 05 05:12:21.963619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 05:12:21.963619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: from cryptography.utils import int_from_bytes Aug 05 05:12:24.217971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 05:12:24.218535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 05:12:24.218870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 05:12:24.218969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 05:12:24.219048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 05:12:24.219154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 05:12:24.219235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 05:12:24.219313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 05:12:24.219391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 05:12:24.219721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 05:12:24.219916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.220924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.221232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.221514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.221645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.221861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.222183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.222462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.222635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.222765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.222856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.223042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-14-iscsi {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.223164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.223384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.223757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-14-iscsi {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.224808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.225989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.226125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.226282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.226585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.226713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.226889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.226997 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.227210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.227440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.227561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.227704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.227845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.228056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.228171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.228373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.228493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.228711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.228816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229776 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-14-iscsi {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.229979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.230077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.230301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.230402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.230613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.230716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.230995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-14-iscsi {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.231103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.231317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.231434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.231604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.231746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.231956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.232075 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.232296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.232392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.232604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.232701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.232928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233703 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.233980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.234176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.234307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.234482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.234614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.234788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.234921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.235989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.236130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.236292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.236406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.236611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.236707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.236927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.237862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.238993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.239215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.239317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.239531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.239675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.239965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240300 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.240897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.241115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.241215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.241414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.241527 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.241721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.241824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242341 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.242966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.243101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.243271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.243380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.243587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.243720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.243932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.244971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.245174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.245270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.245479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.245584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.245783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.245884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.246961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.247137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.247262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.247358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.247565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.247690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.247921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.248919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.249966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.250998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.251184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.251303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.251484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.251602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.251808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.251930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.252121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.252242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.252431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.252559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.252733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.252858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.253035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.253154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.253335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.253461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.253768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.253907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.254996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.255156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.255359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.255520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.255676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.255883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.256977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.257971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.258167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.258274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.258487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.258628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.258769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.258892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.259106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.259331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.259486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.259627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.259809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.259949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260167 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260655 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.260952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.261160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.261284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.261796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.261964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.262798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.262996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.263098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.263318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 05:12:24.263413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.263642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.263747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.264008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.264144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.264369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.264863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265378 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.265955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.266878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.267895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.268978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.269234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.269358 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.269455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.269613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.269810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.269918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.270098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.270250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.270428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.270592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.270751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.270974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.271123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.271306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.271467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.271631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.271836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.271971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.272154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.272283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.272480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.272596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.272801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.272918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.273115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.273245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.273429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.273557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.273745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.273873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.274071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.274186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.274404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.274499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.274716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.274823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.275994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.276094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.276306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.276444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.276613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.276719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.276927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.277955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.278152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.278252 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.278454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.278562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.278756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.278858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.279994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.280103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.280304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.280406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.280608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.280701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.280921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281231 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.281940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.282153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.282254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.282462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.282554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.282769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.282872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.283071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.283164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.283377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.283474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.283687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.283973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.284081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.284280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.284373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.284604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.284737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.284922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.285940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.286144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.286314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.286472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.286628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.286781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.286947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.287105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.287254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.287397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.287546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.287686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.287859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288729 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.288956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.289986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.290188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.290285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.290489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.290592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.290809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.290906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.292954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.293892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.294995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.296961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297062 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.297953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.298119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.298261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.298432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.298572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.298743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.298893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.299055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.299204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.299367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.299525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.299687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.300970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.301080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.301268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.301387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.301581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.301685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.301900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.302069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.302270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.302374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.302612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.302710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.302933 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303341 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.303982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.304196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.304297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.304503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.304592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.304808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.304898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.305116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.305206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.305419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.305508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.305735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.305835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.306977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.307143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.307314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.307471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.307617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.307841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.307993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.308148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.308293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.308444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.308597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.308831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.309140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.314932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.315938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.316947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317553 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.317999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.318947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.319739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.320862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.321384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.321484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.321567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.321638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.321706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.321783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.322262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.322416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.322558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.322708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.322869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.323935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.325241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.325413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.325556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.325705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.325857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.326738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.327939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.328092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.328241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.328390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.328546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.328688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.328828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.330156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.330333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.330493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.330637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.330855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.331005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.331218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.331391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.331565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.331716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.331941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.332942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.333090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.333240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.333496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.333659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.333659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.333943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.334984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.335171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.335325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.335477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.335922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.336074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.336227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.336377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.337234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.337410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.337563 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.337712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.337862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.338945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.339100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.339249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.339402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.339553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.339889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.340039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.340199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.340342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.343182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.343357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.343520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.343684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.343943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.344102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.344254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.344420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.344564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.344716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.344860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.345009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.345211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.345366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.345509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.345690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.345862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.346007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.346148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.346308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.346464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.346637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.346928 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.347110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.347291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.347434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.347586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.347735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.347906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348341 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.348968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.349116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.349257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.349411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.349553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.349702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.349856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.350880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.351981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.352125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.352267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.352421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.352562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.352703 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.352857 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.354497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.354657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.354811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.354964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.355123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.355331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.355525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.355670 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.355841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.356954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.357111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.357253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.357396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.357545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.357740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.357895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.358922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.359590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.359811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.359972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.360115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.360265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.360419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.360562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.360710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.360851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.361002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.361152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.361564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.361716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.361911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362208 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362807 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.362954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.363134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.363662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.363851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.364029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.364176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.364297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.364510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.364759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.364893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.365019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.365153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.365280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.365485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.365485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.367188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.367965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.368946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.369941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.370072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.371331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.371460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.371588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.371715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.371903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.372884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.373900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.374113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.374243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.374592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.374733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.374733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.374985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.375121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.375250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.375595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.375595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.376513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.376898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.377866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.378919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.379063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.379207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.379344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.379656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.379656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.380995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.381919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.382831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.383874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.383874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.383874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.383874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.383874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.384459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.384585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.384585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.384585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.385042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.385177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.385304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.385453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.385453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.385996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.386784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.387531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.387664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.387664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.387947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.388960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.389987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.390489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.390623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.390623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.390913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.391081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.391081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.391383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.391509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.391509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.391808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.392405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.392539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.392666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.392666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.392927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.393938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.394932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.395139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.395139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.395454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.395591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.395591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.396043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.396199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.396199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.396743 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.396874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.397902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.398802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.399039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.399173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.399373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.399504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.399504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.399758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.400893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.401920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.402954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403785 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.403923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.404987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.405122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.405255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.405255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.405508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.405636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.405636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.406027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.406156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.406282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.406617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.406617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.406978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.407136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.407271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.407418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.407418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.407856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.407995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.408165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.408304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.408440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.408573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.408709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.408976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.409105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.409320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.409463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.409634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.409993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.410308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.410433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.410614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.410872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.411003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.411235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.411370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.411574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.411846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.411995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.412202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.412330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.412518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.412729 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.412873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.413127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.413263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.413436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.413614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.413752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.414048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.414184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.414373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.414503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.414706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.414931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.415063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.415325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.415461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.415628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.415923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.416078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.416301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.417134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.417280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.417416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.417542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.417680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.417807 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.418092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.418222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.418410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.418586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.418725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.419014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.419152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.419328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.419502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.419646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.419953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.420096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.420265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.420453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.420591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.420877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.421012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.421185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.421362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.421520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.421777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.421922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.422094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.422264 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.422632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.422770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.422989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.423163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.423299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.423531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.423691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.423966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.424106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.424355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.424497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.424634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.424849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.424979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.425185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.425314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.425544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.425716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.425846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.426082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.426278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.426407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.426596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.426734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.427297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.427446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.427620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.427751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.427901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.428026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.428163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.428304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.428535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.428667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.428843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.429003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.429133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.429439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.429605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.429734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.429918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.430049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.430326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.430464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.430635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.430920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.431055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.431231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.431450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.431594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.431918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.432058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.432185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.432397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.432540 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.432747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.432884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.433057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.433291 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.433429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.433672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.433804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.433976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.434191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.434331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.434622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.434767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.434929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.435098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.435235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.435577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.435752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.435918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.436160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.436299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.436450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.436588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.437046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.437514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.437692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.437832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.437968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.438096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.438230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.438357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.438618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.438746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.438932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.439160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.439358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.439624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.439844 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.440014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.440150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.440328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.440534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.440673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.440937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.441064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.441249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.441434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.441564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.441860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.442000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.442209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.442349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.442488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.442790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.443101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.443410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.443546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.443719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.443957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.444096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.444358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.444501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.444701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.444890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.445021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.445322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.445453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.445700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.445873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.446012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.446257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.446396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.446524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.446746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.446898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.447123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.447498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.447835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.447968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.448095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.448236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.448364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.448364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.448662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.448791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.449079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.449215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.449398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.449557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.449721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.449983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.450128 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.450334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.450461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.450654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.450885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.451022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.451273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.451410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.451585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.451749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.451933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.452250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.452403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.452587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.452723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.452912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.453107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.453246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.453509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.453648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.453813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.454029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.454158 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.454425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.454553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.454735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.454913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.458683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.458841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.458993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.458993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.459262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.459392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.459519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.459654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.459654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.459942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.460982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.461885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.462783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.463829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.464942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.465023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.465300 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.465381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.465614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.465705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.465927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.466957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.467200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.467285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.467692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.467958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.468056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.468138 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.468233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.468464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.468721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.468815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.469081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.469386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.469481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.469710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.469951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.470078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.470318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.470503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.470630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.470941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.471040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.471258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.471520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.471624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.471902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.472219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473112 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.473774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.474054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.474151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.474438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.474584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.474754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.475073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.475176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.475415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.475622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.475726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.476063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.476188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.476370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.476616 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 05:12:24.476715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.477116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.477516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.478008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.478345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.478751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.479306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.479721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.480145 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.480546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.480953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.481353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.481779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.482186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.482637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.483056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.483483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.483926 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.484337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.484744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.485193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.485895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.486596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.487032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.487454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.488253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.488422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.488830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.489432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.490043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.490371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.490784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.491194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.491603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.492035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.492447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.492853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.493261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.493668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.494073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.494477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.494901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.495306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.495711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.496135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.496553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.497003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.497420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.497833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.498421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.498731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.499103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.499634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.500202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.500493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.500905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.501338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.501756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.502168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.502702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.503108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.503658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.503973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.504429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.504855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.505355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.505763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.506180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.506589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.507013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.507477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.508582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.508933 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.509342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.509742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.510141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.510677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.511097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.511524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.512394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.512394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.512724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.513124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.513527 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.513929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.514328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.514735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.515139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.515530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.516345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.516345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.517108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.517325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.517681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.518077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.518730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.519113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.519519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.519971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.520536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.521080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.521498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.521936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.522351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.522765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.523171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.523590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.524038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.524475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.524863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.525296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.525700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.526106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.526514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.526939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.527344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.527756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.528209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.528883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.529056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.529431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.529848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.530266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.530859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.531271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.531698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.532135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.532564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.533100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.533280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.533600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.533922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.534240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.534553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.534875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.535195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.535528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.535890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.536206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.536630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.536960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.537335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.537656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.538007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.538343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.538649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.538966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.539271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 05:12:24.539515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 05:12:24.631361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO dbcounter [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Registered counter for database nova_api Aug 05 05:12:24.651944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_db.sqlalchemy.engines [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.658501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writer thread running {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.694604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO dbcounter [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Registered counter for database nova_api Aug 05 05:12:24.714574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_db.sqlalchemy.engines [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.715797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.context [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d40b831a-f22f-4ca8-ad5d-c9bb9a692e13(cell1) {{(pid=117903) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 05:12:24.719904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:12:24.720376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:12:24.721739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writer thread running {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.721878 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:12:24.722638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:12:24.723080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:12:24.725166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:12:24.727146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO dbcounter [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Registered counter for database nova_cell0 Aug 05 05:12:24.731226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO dbcounter [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Registered counter for database nova_cell1 Aug 05 05:12:24.738611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_db.sqlalchemy.engines [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.741848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_db.sqlalchemy.engines [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.745283 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writer thread running {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.777920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.context [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d40b831a-f22f-4ca8-ad5d-c9bb9a692e13(cell1) {{(pid=117902) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 05:12:24.781915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:12:24.782389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:12:24.783984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:12:24.784711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:12:24.785160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:12:24.787218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:12:24.789616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO dbcounter [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Registered counter for database nova_cell0 Aug 05 05:12:24.793981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO dbcounter [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Registered counter for database nova_cell1 Aug 05 05:12:24.802022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_db.sqlalchemy.engines [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.804631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_db.sqlalchemy.engines [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.809483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writer thread running {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.815370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writer thread running {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.882808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writer thread running {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.893061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO dbcounter [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Registered counter for database nova_cell0 Aug 05 05:12:24.902095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_db.sqlalchemy.engines [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.907134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writer thread running {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:24.956093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO dbcounter [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Registered counter for database nova_cell0 Aug 05 05:12:24.963726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_db.sqlalchemy.engines [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 05:12:24.968634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writer thread running {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 05:12:25.222958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: WARNING keystonemiddleware.auth_token [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:12:25.230333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: WARNING keystonemiddleware.auth_token [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:12:25.281195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: WARNING keystonemiddleware.auth_token [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:12:25.288533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: WARNING keystonemiddleware.auth_token [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:12:25.578681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: WARNING keystonemiddleware.auth_token [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:12:25.585120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: WARNING keystonemiddleware.auth_token [None req-9c7c5283-ac6f-459d-8e2a-004b75fcc68e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:12:25.591654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560c15c1d9c0 pid: 117903 (default app) Aug 05 05:12:25.635995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: WARNING keystonemiddleware.auth_token [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 05:12:25.643271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: WARNING keystonemiddleware.auth_token [None req-794059f2-42b8-4fa5-8085-58d850306b57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 05:12:25.649421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560c15c1d9c0 pid: 117902 (default app) Aug 05 05:12:59.762396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:59.764417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:59.765285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:12:59.766070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:01.243151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bd940a6b-6065-4c0c-98f6-dd556dd7ee90 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Action: 'create', calling method: .version_select at 0x7fdc9fba9dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1731623423", "metadata": {"Type": "work"}}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:02.291985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bd940a6b-6065-4c0c-98f6-dd556dd7ee90 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.546096 Aug 05 05:13:02.293059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Aug 5 05:12:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2549 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 05:13:02.441241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8567206a-f048-4c72-9769-c23b0b3150de tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa9ac10>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:02.557260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8567206a-f048-4c72-9769-c23b0b3150de tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/09d012fc-4fcd-4b93-87b8-00b9e50e176c" status: 200 len: 350 microversion: 2.1 time: 0.121122 Aug 05 05:13:02.559527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:02 2022] GET /compute/v2.1/os-volumes/09d012fc-4fcd-4b93-87b8-00b9e50e176c => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:02.596977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-345fdf86-f9b4-47a3-ae26-af4df0590035 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Calling method '.version_select at 0x7fdc9fc81940>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:02.626473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:02.627689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:02.629006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:02.630337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:03.328518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-345fdf86-f9b4-47a3-ae26-af4df0590035 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd" status: 200 len: 354 microversion: 2.1 time: 1.023923 Aug 05 05:13:03.329362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:02 2022] GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd => generated 354 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:03.342581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e08d8a86-cde6-4810-bd75-ffaf234485f6 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Calling method '.version_select at 0x7fdc9fa383a0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:03.526914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e08d8a86-cde6-4810-bd75-ffaf234485f6 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd" status: 200 len: 354 microversion: 2.1 time: 0.188472 Aug 05 05:13:03.527586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:03 2022] GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd => generated 354 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:03.546427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7f7eebd8-50be-415a-afea-f08f901fd429 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Calling method '.version_select at 0x7fdc9fad4ca0>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:03.806369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7f7eebd8-50be-415a-afea-f08f901fd429 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd" status: 202 len: 0 microversion: 2.1 time: 0.264010 Aug 05 05:13:03.816898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 2/5] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:13:03 2022] DELETE /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:13:03.817872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-76b429c8-6fd8-4dff-8827-52d51950834a tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Calling method '.version_select at 0x7fdc9fa38a60>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:04.019501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-76b429c8-6fd8-4dff-8827-52d51950834a tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd" status: 200 len: 353 microversion: 2.1 time: 0.207344 Aug 05 05:13:04.020434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:03 2022] GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:04.672191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-20ba1df1-4ed8-40ae-9a45-56b5a6d96482 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fad4c10>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:04.762857 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-20ba1df1-4ed8-40ae-9a45-56b5a6d96482 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6a4f143a-33f7-48af-aca5-2ee9a020ce97" status: 200 len: 351 microversion: 2.1 time: 0.094480 Aug 05 05:13:04.763721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:04 2022] GET /compute/v2.1/os-volumes/6a4f143a-33f7-48af-aca5-2ee9a020ce97 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:05.034330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5bbfeccb-36c8-4dd0-8695-1ee2b50ceb60 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Calling method '.version_select at 0x7fdc9fa9adc0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:05.090804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-5bbfeccb-36c8-4dd0-8695-1ee2b50ceb60 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] HTTP exception thrown: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5bbfeccb-36c8-4dd0-8695-1ee2b50ceb60 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Request method failure captured: Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd HTTP/1.1 Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KbbnVLTxPQRJ-QmPNV0bLq0TT2b4GCPOjVttIvC3lqs0gvTx9d7BD07ZxIFpC7BHVTTJbh1lrbD7sgJigMA_t8JxNwhuMeHrIeN-OXnIWY9-95s81NNXG7_4x30TJHf8lzcyr8VGgFRoYF68-mkhmkKULdgKHQPtfaOOX_iXmRlj9A Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: d55cdc16c75f4fda92582251296ae60c Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesGetTestJSON-304973413 Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:13:05.094944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d55cdc16c75f4fda92582251296ae60c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d55cdc16c75f4fda92582251296ae60c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d55cdc16c75f4fda92582251296ae60c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d55cdc16c75f4fda92582251296ae60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesGetTestJSON-304973413 Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: d55cdc16c75f4fda92582251296ae60c Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesGetTestJSON-304973413 Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesGetTestJSON-304973413-project Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 0c27df6b5e8042e2be0092d727a2344f Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesGetTestJSON-304973413-project Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '2a202c31-f03b-4203-8583-d64896b75dbd'} Aug 05 05:13:05.096705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. (HTTP 404) (Request-ID: req-fe9d2b40-a632-46d1-b62a-57c88e9494d5) Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:13:05.097715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:13:05.153764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 05:13:05.157542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5bbfeccb-36c8-4dd0-8695-1ee2b50ceb60 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] Returning 404 to user: Volume 2a202c31-f03b-4203-8583-d64896b75dbd could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5bbfeccb-36c8-4dd0-8695-1ee2b50ceb60 tempest-VolumesGetTestJSON-304973413 tempest-VolumesGetTestJSON-304973413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd" status: 404 len: 109 microversion: 2.1 time: 0.067238 Aug 05 05:13:05.159143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:05 2022] GET /compute/v2.1/os-volumes/2a202c31-f03b-4203-8583-d64896b75dbd => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:13:06.636815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cc1b3814-a3d3-4f3c-afb4-9cd662f9a937 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa984c0>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:06.788703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cc1b3814-a3d3-4f3c-afb4-9cd662f9a937 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c4497e8e-d538-4be7-9736-0edb44785733" status: 200 len: 351 microversion: 2.1 time: 0.155500 Aug 05 05:13:06.792452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 4/9] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:13:06 2022] GET /compute/v2.1/os-volumes/c4497e8e-d538-4be7-9736-0edb44785733 => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:06.804520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d107f963-cafc-492b-8896-168a85a64afc tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdca03aa0d0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:07.031621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d107f963-cafc-492b-8896-168a85a64afc tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.231705 Aug 05 05:13:07.051250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1134 bytes} [Fri Aug 5 05:13:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:07.055493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f2db33d2-baa6-4f48-a10d-3f4cd3fd3605 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa98a60>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:07.287708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f2db33d2-baa6-4f48-a10d-3f4cd3fd3605 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.242079 Aug 05 05:13:07.304509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 5/11] 10.222.0.30 () {58 vars in 1149 bytes} [Fri Aug 5 05:13:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:07.306858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-56338833-0776-447c-8b4e-dc9f56840186 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa0aee0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:07.455213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-56338833-0776-447c-8b4e-dc9f56840186 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.153853 Aug 05 05:13:07.470355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1134 bytes} [Fri Aug 5 05:13:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:07.472338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5eed9e9e-f85d-49b3-9e49-c7a80d1dcfa8 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa98af0>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:07.662358 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5eed9e9e-f85d-49b3-9e49-c7a80d1dcfa8 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.196404 Aug 05 05:13:07.663895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1167 bytes} [Fri Aug 5 05:13:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:07.681521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cab36b2e-be5f-493f-aacc-bb30eeca4eab tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9f9a6160>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:07.940712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cab36b2e-be5f-493f-aacc-bb30eeca4eab tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.266177 Aug 05 05:13:07.950443 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 8/14] 10.222.0.30 () {58 vars in 1170 bytes} [Fri Aug 5 05:13:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:07.960764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5ad7842a-2438-4b0f-9f45-c43895241c65 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa24dc0>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:08.157394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5ad7842a-2438-4b0f-9f45-c43895241c65 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.205415 Aug 05 05:13:08.166410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 7/15] 10.222.0.30 () {58 vars in 1155 bytes} [Fri Aug 5 05:13:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:08.171800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d5177fd1-db87-4c0d-b7f4-207acc11dff9 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9f9a6a60>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:08.381301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d5177fd1-db87-4c0d-b7f4-207acc11dff9 tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.213433 Aug 05 05:13:08.381876 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1188 bytes} [Fri Aug 5 05:13:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:08.395213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a69328ac-bf47-4059-9fb4-39ea1287f7dc tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] Calling method '.version_select at 0x7fdc9fa98790>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:08.599941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a69328ac-bf47-4059-9fb4-39ea1287f7dc tempest-VolumesTestJSON-782232687 tempest-VolumesTestJSON-782232687-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.208657 Aug 05 05:13:08.608440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1155 bytes} [Fri Aug 5 05:13:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:12.837742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fe6af1be-16cc-458d-b45b-5762f740dd7b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: .version_select at 0x7fdc9fa37670>, body: {"keypair": {"name": "tempest-keypair-1266663217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ1mDL+ud2z1LcdXJYhELfOUfxHi4xru2nSVHA6LLL5G+tDIrFD35zVHSkK6XW7UYnnVVNAV9cQ1iNJOJQnPMBU0CLyKwgcYzh0nzhS/1Fk8Smyk9Cf8CwlaBBQqYd7A=="}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:13.040531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-fe6af1be-16cc-458d-b45b-5762f740dd7b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for project 27c58f39e03f42d5862a6a64194f5711. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:13.061368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-fe6af1be-16cc-458d-b45b-5762f740dd7b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for user 04eb412804c247908f8d377a42d1ea63 and project 27c58f39e03f42d5862a6a64194f5711. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:13.220853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fe6af1be-16cc-458d-b45b-5762f740dd7b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.126573 Aug 05 05:13:13.221839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 10/18] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:13:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:19.145219 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-74014371", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:19.194312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1461266094", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "networks": [{"uuid": "68a0f00a-ce45-4cef-9645-3b7a8c8ac927"}]}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:19.339204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] validate_networks() for [('68a0f00a-ce45-4cef-9645-3b7a8c8ac927', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:13:19.361643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] validate_networks() for [('3e849852-6742-4bcf-aa40-3ba3f2f184cd', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:13:21.047236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:13:21.048012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:13:21.048239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:13:21.048878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:13:21.049423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:13:21.087982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:21.089437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:21.089883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:21.090063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:13:21.090565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:13:21.090647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:21.090933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:13:21.091061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:21.091335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:13:21.091488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:21.091735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:13:21.100993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:21.101459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:21.101885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:21.102595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:21.103037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:21.103759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:21.142313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Getting quotas for project 08e98cefc4d147bba944a1cf82f2e772. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:21.156063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Getting quotas for user 28432f2e1dea486cb163fa2dab6e443f and project 08e98cefc4d147bba944a1cf82f2e772. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:21.170782 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:13:21.173839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:13:21.220545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:21.252256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for user c7c57f5e11a84bf98d474837adbb0ba7 and project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:21.306230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:13:21.309170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:13:21.341527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-de1dd6b3-3d76-40f3-9b88-9ad80e93902f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.426144 Aug 05 05:13:21.344814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 11/19] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 05:13:21.359055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-795740744", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17181fe8-2fbd-4695-9e7f-4006b5acd444"}], "security_groups": [{"name": "tempest-securitygroup--949285088"}], "key_name": "tempest-keypair-1266663217", "user_data": "}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:21.492593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4b24c0ba-3bd9-45ac-9ac2-1fa8196314e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.946935 Aug 05 05:13:21.494814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 9/20] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:13:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:13:21.677168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] validate_networks() for [('17181fe8-2fbd-4695-9e7f-4006b5acd444', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:13:21.817434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e5279807-b248-4cac-81f0-564e576e2bb0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'create', calling method: .version_select at 0x7fdc9f134670>, body: {"keypair": {"name": "tempest-keypair-2109074787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAqCYd4G9mAnU+BTRE1o+L2LsflbWYOvPRQPJ8mQq5fNxg0Ov+q8YMZPamoLa+XxzsYKe1L6yXvu4wnC8AxDxT9kNCBhcoiIqLs9eg1EwCrShTbvAmLc9HbfPb1EzfDbw=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:21.865952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-e5279807-b248-4cac-81f0-564e576e2bb0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for project e43f69b71a364a63850d3008309e0c68. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:21.879648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-e5279807-b248-4cac-81f0-564e576e2bb0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for user b89279618557486f9d5b358b654a906e and project e43f69b71a364a63850d3008309e0c68. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:21.978736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e5279807-b248-4cac-81f0-564e576e2bb0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.468464 Aug 05 05:13:21.979792 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 10/21] 10.222.0.30 () {62 vars in 1200 bytes} [Fri Aug 5 05:13:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 484 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 05:13:21.992794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2952b20e-9ecf-46ed-97c8-80ba556c54d9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:22.002106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2952b20e-9ecf-46ed-97c8-80ba556c54d9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:22.398433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2952b20e-9ecf-46ed-97c8-80ba556c54d9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:22.456273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2952b20e-9ecf-46ed-97c8-80ba556c54d9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1215 microversion: 2.1 time: 0.475280 Aug 05 05:13:22.468108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:21 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1215 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:22.476362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aa559c6b-5e8f-47a8-8e1c-05f67ba41fea tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:22.483679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aa559c6b-5e8f-47a8-8e1c-05f67ba41fea tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:22.769478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-aa559c6b-5e8f-47a8-8e1c-05f67ba41fea tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:22.816419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aa559c6b-5e8f-47a8-8e1c-05f67ba41fea tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1220 microversion: 2.1 time: 0.346616 Aug 05 05:13:22.817201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:22 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1220 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:23.009117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1591108722", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:23.087493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] validate_networks() for [('3e849852-6742-4bcf-aa40-3ba3f2f184cd', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:13:23.631428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:13:23.631988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:13:23.632484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:13:23.632819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:13:23.633386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:13:23.656845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:23.658324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:23.658811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:23.659957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:23.660425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:23.660980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:23.704642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for project 27c58f39e03f42d5862a6a64194f5711. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:23.710270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for user 04eb412804c247908f8d377a42d1ea63 and project 27c58f39e03f42d5862a6a64194f5711. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:23.750915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:13:23.753326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:13:23.862009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-84dd8d3c-86d4-4554-941f-55d72b655761 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.515615 Aug 05 05:13:23.868831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 12/24] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:13:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:13:23.874329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:23.879140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:23.914707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:23.915356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:23.918130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:23.918969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:23.919617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:23.920158 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:24.448235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:13:24.449992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:13:24.450621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:13:24.451178 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:13:24.451967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:13:24.471154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:24.475388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:24.476166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:24.476874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:24.477793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:24.478405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:24.480084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:24.508674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-44ff256c-317b-497c-b911-444a7010a0c1 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1219 microversion: 2.1 time: 0.638401 Aug 05 05:13:24.509751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:23 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1219 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:24.514724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8c13da07-873f-4329-ae24-45dabcd74e87 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:24.515411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8c13da07-873f-4329-ae24-45dabcd74e87 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:24.530577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:24.538185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for user c7c57f5e11a84bf98d474837adbb0ba7 and project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:24.592731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:13:24.596217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:13:24.654618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8c13da07-873f-4329-ae24-45dabcd74e87 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:24.678612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8c13da07-873f-4329-ae24-45dabcd74e87 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1237 microversion: 2.1 time: 0.167531 Aug 05 05:13:24.692936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-74fbebf1-4801-4ab9-9bf2-8b31108323ae tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.672529 Aug 05 05:13:24.694061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 14/26] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:24 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1237 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:24.694272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 13/27] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:13:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 05:13:24.709332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-02a3db78-b958-4500-a4ec-0f432262bb09 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:24.710280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-02a3db78-b958-4500-a4ec-0f432262bb09 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:24.863842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-02a3db78-b958-4500-a4ec-0f432262bb09 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:24.871577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-02a3db78-b958-4500-a4ec-0f432262bb09 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1222 microversion: 2.1 time: 0.170607 Aug 05 05:13:24.887508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 15/28] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:24 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:25.533718 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:25.540575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:25.556497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:25.557386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:25.557980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:25.558854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:25.561421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:25.562046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:25.699708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:25.700961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:25.716549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:25.717244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:25.717838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:25.718699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:25.719734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:25.720358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:25.889290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:25.897693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-86f21183-c430-4600-a3e3-63b4a3d668e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1233 microversion: 2.1 time: 0.202378 Aug 05 05:13:25.897858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 16/29] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:25 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1233 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:25.911371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-223273208", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2011a265-bb45-44e0-bde0-703ac89b046e"}], "security_groups": [{"name": "tempest-securitygroup--289672777"}], "key_name": "tempest-keypair-2109074787", "user_data": "}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:25.934566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:25.961018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8d33084f-9dd3-4363-96ed-d983cbbfa2ee tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1273 microversion: 2.1 time: 0.431041 Aug 05 05:13:25.977017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 14/30] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:25 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1273 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:25.982249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:25.983206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:25.990974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:25.991622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:25.992307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:25.993270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:25.993981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:25.994566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:26.096259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] validate_networks() for [('2011a265-bb45-44e0-bde0-703ac89b046e', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:13:26.151495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:26.167806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a23fb13c-701d-4fe0-a2d3-b4c1f5b7bde4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1226 microversion: 2.1 time: 0.189266 Aug 05 05:13:26.168408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:25 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1226 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:26.551506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:13:26.551974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:13:26.552452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:13:26.552929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:13:26.553342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:13:26.562792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:26.563462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:26.563920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:26.564638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:26.565091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:26.565508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:26.582647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for project e43f69b71a364a63850d3008309e0c68. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:13:26.586373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for user b89279618557486f9d5b358b654a906e and project e43f69b71a364a63850d3008309e0c68. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:13:26.599327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:13:26.601530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:13:26.653477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-95f18017-0b5c-45a3-bc47-c0bc2a58cd23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.754623 Aug 05 05:13:26.654132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 17/32] 10.222.0.30 () {62 vars in 1188 bytes} [Fri Aug 5 05:13:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 05:13:26.666052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-22234227-7e7c-4018-9548-d043044c9a42 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:26.666703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-22234227-7e7c-4018-9548-d043044c9a42 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:26.726034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-22234227-7e7c-4018-9548-d043044c9a42 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:26.734739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-22234227-7e7c-4018-9548-d043044c9a42 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:26.736467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-22234227-7e7c-4018-9548-d043044c9a42 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:26.737832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-22234227-7e7c-4018-9548-d043044c9a42 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1281 microversion: 2.20 time: 0.076408 Aug 05 05:13:26.738520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 16/33] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:26 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:26.921010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:26.922270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:26.929868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:26.930328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:26.930955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:26.931658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:26.932151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:26.932607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:26.987979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:26.989134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:26.997227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:27.001081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:27.001815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:27.002717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:27.003308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:27.003891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:27.012882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:27.021878 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-254e38a1-5bb8-4a93-9e35-6b8352878a40 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1233 microversion: 2.1 time: 0.105773 Aug 05 05:13:27.022459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:26 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1233 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:27.088036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:27.096320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7ac76ab1-ea14-4323-bbd3-ca281245d105 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1273 microversion: 2.1 time: 0.114533 Aug 05 05:13:27.096897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 17/35] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:26 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:27.191156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:27.191917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:27.205448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:27.205994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:27.206465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:27.207205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:27.207913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:27.208686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:27.293649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:27.301363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9fbd966-9bd1-426b-af2f-fbf1466d5f49 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1226 microversion: 2.1 time: 0.113953 Aug 05 05:13:27.302224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 19/36] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:27 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:27.761447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:27.762073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:27.768189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:27.768664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:27.769098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:27.770027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:27.770482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:27.770904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:27.834009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:27.841953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:27.843456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:27.844589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9cc9d46a-f5bf-41eb-a1ed-840b3c800885 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1285 microversion: 2.20 time: 0.087477 Aug 05 05:13:27.845157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:27 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:28.045148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:28.046263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:28.053654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.054276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.054776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.055513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.056213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.056622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.117734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:28.119380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:28.121150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:28.126272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.126938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.127597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.128597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.128934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.129048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-27639607-7a34-40a6-b7de-485598e48823 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1233 microversion: 2.1 time: 0.090175 Aug 05 05:13:28.129605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 20/38] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:28 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:28.130371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.191922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:28.199352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e263826b-4d81-45af-8510-c9f5ac051dbe tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1273 microversion: 2.1 time: 0.085556 Aug 05 05:13:28.199956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 19/39] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:28 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:28.324031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:28.324586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:28.333673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.334751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.335862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.336814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.337286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.337711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.411908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:28.421489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-940626f8-292c-4932-87f9-ab461808ecf9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1226 microversion: 2.1 time: 0.102875 Aug 05 05:13:28.422425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:28 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:28.867319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:28.867892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:28.901203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.901711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.903570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:28.906449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:28.908263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:28.912108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:29.111551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:29.127220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:29.131320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:29.135411 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-354a08e2-0992-4b8d-8da4-0bf9e5c0ed02 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1277 microversion: 2.20 time: 0.272108 Aug 05 05:13:29.138660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:28 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:13:29.163567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:29.167357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:29.179581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:29.183814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:29.184351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:29.185634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:29.188182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:29.189002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:29.222343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:29.223535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:29.236984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:29.237505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:29.237942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:29.238764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:29.242596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:29.245126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:29.315242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:29.325076 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-69c787dd-d228-4f53-babb-1365b564ae44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1289 microversion: 2.1 time: 0.171747 Aug 05 05:13:29.328217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 22/42] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:29 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1289 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:29.350560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:29.366091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f1a2ebdd-3175-4795-b900-2e5bbd03b54b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1273 microversion: 2.1 time: 0.149421 Aug 05 05:13:29.367370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:29 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:29.444657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:29.445514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:29.461596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:29.462102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:29.467972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:29.469509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:29.470500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:29.470845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:30.163048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:30.164478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:30.179676 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:30.181387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:30.184183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:30.187116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:30.188404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:30.190036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:30.230028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:30.245566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3f23fedb-95b9-4b7f-8908-f5333d150768 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1274 microversion: 2.1 time: 0.806084 Aug 05 05:13:30.247531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 23/44] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:29 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1274 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:30.346493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:30.347308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:30.366963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:30.368953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:30.373010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:30.380317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:30.380975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:30.382660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:31.004267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:31.030983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:31.033020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:31.042230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c5d3efac-fb07-4ed1-8d23-dcf84e3bace2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1333 microversion: 2.20 time: 0.879807 Aug 05 05:13:31.044175 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:30 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1333 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:31.054682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:31.056170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:31.091744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:31.092287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:31.095877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:31.097078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:31.099446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:31.101733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:31.154391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:31.163248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-710a0638-051a-4821-90b7-928950d9fdb7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1307 microversion: 2.1 time: 0.821159 Aug 05 05:13:31.173716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 24/46] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:30 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1307 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:31.268771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:31.270872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:31.291559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:31.294108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:31.296508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:31.298267 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:31.306172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:31.310071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:31.994286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:32.010564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f8463247-861d-4a07-8be3-24c50b3b635e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1280 microversion: 2.1 time: 0.746724 Aug 05 05:13:32.018289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 25/47] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:31 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1280 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:32.066596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:32.067499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:32.083462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:32.087007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:32.087561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:32.091423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:32.096153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:32.097021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:32.343009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:32.362997 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:32.363994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:32.367332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-74b88745-d776-442a-8fcb-0e0d0a0e83c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1339 microversion: 2.20 time: 0.305058 Aug 05 05:13:32.369214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:32.370757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 26/48] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:32 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:32.376998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:32.377818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:32.387341 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c6437c12-379d-4598-9827-04fd753350b4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 1.339797 Aug 05 05:13:32.389619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 23/49] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:31 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:32.400970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:32.401476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:32.401929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:32.402722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:32.407943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:32.409253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:32.627275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:32.641651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-81e37c86-bbb3-4a55-8415-d557e9a71e28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1295 microversion: 2.1 time: 0.264668 Aug 05 05:13:32.645082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 27/50] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:32 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1295 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:33.040048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:33.041435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:33.053809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.060293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.068733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.073454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.074073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.074636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.335797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:33.350320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0d0c18ff-733b-4e91-a09f-821e4aedb8f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1280 microversion: 2.1 time: 0.315445 Aug 05 05:13:33.367952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 24/51] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:33 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:33.396561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:33.397319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:33.413661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:33.414374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:33.430696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.434803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.435643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.436859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.439059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.440596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.444276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.444276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.444434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.444677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.445093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.452525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.668251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:33.685007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:33.686518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:33.688109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-856c8f2c-3fd0-4feb-bf27-3d50be194992 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1339 microversion: 2.20 time: 0.300014 Aug 05 05:13:33.689143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 28/52] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:33 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:33.694215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:33.694821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:33.710312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:33.712062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.719013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.719705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.720618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:33.721210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:33.721804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:33.914923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:33.924108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-55d5f372-3081-4a80-a451-08e5185c5877 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1295 microversion: 2.1 time: 0.233662 Aug 05 05:13:33.924757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 29/53] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:33 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:34.382900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:34.383555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:34.402995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:34.414784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:34.416709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dd561c4f-5ca3-420b-9ebe-553a7540eecf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 1.010178 Aug 05 05:13:34.434610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:34.435875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 25/54] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:33 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:34.436514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:34.437422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:34.439956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:34.440559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:34.599122 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:34.614424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a8279f5b-f4bd-47c5-ad78-d41c7690b361 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1280 microversion: 2.1 time: 0.235613 Aug 05 05:13:34.644400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 30/55] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:34 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1280 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:34.713408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:34.714025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:34.726444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=4 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:34.748288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:34.750881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:34.753269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:34.754568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:34.760328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:34.760853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:34.947880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:34.947880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:34.968857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:34.969533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:34.972133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:34.973196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:34.973937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:34.976403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:35.034873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:35.860706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:35.877125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:35.878981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:35.880432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c77efab2-0eaa-4530-a471-738ae01248cd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1339 microversion: 2.20 time: 1.173652 Aug 05 05:13:35.881189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 26/56] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:34 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1339 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:35.895959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:35.896840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:35.908326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:35.909103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:35.909736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:35.910697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:35.911303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:35.911938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:36.160720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:36.174806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c455845b-69f4-4864-9841-cb2a1f453076 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 1.233467 Aug 05 05:13:36.188860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 31/57] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:34 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:36.196202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:36.197041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:36.204462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:36.205187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:36.205806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:36.206669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:36.207308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:36.207939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:36.574204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:36.592955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=26 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:36.730887 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=22 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:37.298816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:37.310900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-29947d22-6b96-4ea6-8bed-cf8e22a092db tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 1.428431 Aug 05 05:13:37.312507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 27/58] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:35 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:37.318444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:37.319306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:37.326654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:37.327451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:37.328259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:37.329171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:37.329897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:37.330572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:37.766050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:37.774343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-52c39686-a5f5-4caf-8cec-b1f17c256e47 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 1.584020 Aug 05 05:13:37.784487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 32/59] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:36 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:37.797618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:37.805891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:37.824030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:37.825057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:37.826392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:37.828869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:37.829502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:37.833066 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:38.475665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:38.488671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:38.499678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:38.502669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cf668f8e-2994-44f0-bda6-1d209ed5c893 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 1.187209 Aug 05 05:13:38.507338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 28/60] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:37 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:38.875627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e23597-d90a-46cc-9d83-8c03ce58eb4b", "tag": "bacfc5f3-58b7-4ad6-8102-def308053a79"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:38.913195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:38.913732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:38.916308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:38.965003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Creating event network-changed:bacfc5f3-58b7-4ad6-8102-def308053a79 for instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b on hv-cinder-81558 Aug 05 05:13:38.965548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 05:13:38.965930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1eba48e6-1811-49dd-ab0b-84d8574da2e5 req-e8ece343-101c-49a7-bbe3-159b416231f7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 05:13:38.967021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:38.967475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:38.976129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:38.980086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:38.980609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:38.982701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:39.039106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.compute.rpcapi [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 05:13:39.040081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] Releasing lock "compute-rpcapi-router" {{(pid=117902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 05:13:39.082752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8e8e7b8a-47f3-4861-8a51-625d6110427d None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560759 Aug 05 05:13:39.083647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 29/61] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:39.088844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:39.089587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:39.111466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:39.113653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:39.114119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:39.116339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:39.116808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:39.117234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:39.305462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:39.316422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c9165878-97bb-4aeb-b652-12ba995986ff tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 1.529045 Aug 05 05:13:39.317517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 33/62] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:37 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:39.329911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:39.334058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:39.354452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:39.357181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:39.358281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:39.360237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:39.362037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:39.363863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:39.799265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:39.817827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5fcfdba5-ce27-42fe-882c-6540fcf2f824 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.496662 Aug 05 05:13:39.818761 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 34/63] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:39 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:39.823731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:39.824586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:39.840328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:39.841566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:39.841916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:39.842979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:39.846616 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:39.849679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:40.166320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:40.176318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-361aa503-3b04-4120-9ac6-1dff3d7cbc2d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 1.091354 Aug 05 05:13:40.183492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 30/64] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:39 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:40.773001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-7df6c50e-b19b-4ecc-88b6-16bfaaba9236 req-f1dc5346-c3df-49de-a9b5-7f65c75ab1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff6e938-a58e-4bba-8294-f82b51bc8780", "tag": "698c4ba3-9bf4-4e10-8b7a-e178c5935a51"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:40.795151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7df6c50e-b19b-4ecc-88b6-16bfaaba9236 req-f1dc5346-c3df-49de-a9b5-7f65c75ab1d4 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:40.797293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:40.799305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7df6c50e-b19b-4ecc-88b6-16bfaaba9236 req-f1dc5346-c3df-49de-a9b5-7f65c75ab1d4 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:40.801524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7df6c50e-b19b-4ecc-88b6-16bfaaba9236 req-f1dc5346-c3df-49de-a9b5-7f65c75ab1d4 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:40.810607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:40.812641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:40.813085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:40.820228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2b5f4b3a-294e-45cf-987b-64f37527be54 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 1.000086 Aug 05 05:13:40.823958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 35/65] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:39 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:40.830849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:40.831704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:40.856449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:40.857886 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:40.858906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:40.860622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:40.862354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:40.863370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:40.865720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-7df6c50e-b19b-4ecc-88b6-16bfaaba9236 req-f1dc5346-c3df-49de-a9b5-7f65c75ab1d4 service nova] Creating event network-changed:698c4ba3-9bf4-4e10-8b7a-e178c5935a51 for instance aff6e938-a58e-4bba-8294-f82b51bc8780 on hv-cinder-81558 Aug 05 05:13:40.888756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-7df6c50e-b19b-4ecc-88b6-16bfaaba9236 req-f1dc5346-c3df-49de-a9b5-7f65c75ab1d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702636 Aug 05 05:13:40.897815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 31/66] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:40.910987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:40.914674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:40.932309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:40.933249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:40.937708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:40.939308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:40.954907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:40.955329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.668306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:41.683867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-800e8a0e-19a2-4adf-a1ae-9958ee9e7807 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.784260 Aug 05 05:13:41.684685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 32/67] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:40 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:41.703363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:41.704555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:41.720942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.721756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.722349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.723549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.724227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.724811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.789269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:41.797348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-24159355-6695-4095-88a3-3cf6832360e8 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.972075 Aug 05 05:13:41.798012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 36/68] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:40 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:41.816043 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a66383-4727-4bd4-bea6-68c1e9e9f3d0", "tag": "f49600d8-fdfd-4eae-a883-09ec80b1d6d3"}, {"name": "network-changed", "server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:41.831047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.831537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.832002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.859232 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Creating event network-changed:f49600d8-fdfd-4eae-a883-09ec80b1d6d3 for instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 on hv-cinder-81558 Aug 05 05:13:41.859736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Creating event network-changed:fce17f2c-7a6f-4061-9c80-3211fcf7ac05 for instance 5edf8301-151e-4713-83c9-fe12e7517fe0 on hv-cinder-81558 Aug 05 05:13:41.861411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 05:13:41.861811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f2eef19-ed60-4833-9175-a4eefadeb8ad req-1d26384b-6253-4536-9553-307330367149 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 05:13:41.862861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.863348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.869559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.870080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.870579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.871068 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.880072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.compute.rpcapi [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 05:13:41.881028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] Releasing lock "compute-rpcapi-router" {{(pid=117903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 05:13:41.909623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-aaea2281-bac4-451a-801c-c87db568b424 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.097431 Aug 05 05:13:41.911058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 37/69] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:41.918271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:41.918973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:41.926693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.927315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.927756 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:41.928613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:41.929149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:41.929835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:42.070604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:42.078322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d07fece8-7f81-40fa-aac6-d9f2e52c91a7 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.379925 Aug 05 05:13:42.079446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 33/70] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:41 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:42.258406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:42.271425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:42.274718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:42.277855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f9da6321-e636-47b1-a798-3c8c737d4570 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.365415 Aug 05 05:13:42.279444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 38/71] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:41 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:42.709092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:42.710120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:42.721710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:42.723423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:42.726375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:42.727292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:42.727866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:42.728289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:42.821808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:42.822620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:42.833891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:42.834404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:42.834871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:42.835566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:42.840047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:42.840979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:43.015092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:43.024643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-10bae5e3-8733-41eb-8652-47a7cfa6b446 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.323478 Aug 05 05:13:43.025233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 34/72] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:42 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:43.075749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:43.083096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4fca4b30-8164-4d21-8768-ac57a03d13b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.266047 Aug 05 05:13:43.083661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 39/73] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:42 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:43.099708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:43.100360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:43.108475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:43.108904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:43.109390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:43.110010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:43.110459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:43.110934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:43.263085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:43.273097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5692b1ff-2425-48ce-86c5-8b7d9e6275c4 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.177439 Aug 05 05:13:43.273836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 35/74] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:43 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:43.302328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:43.303103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:43.309410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-e076fadb-1b54-4e7b-9f96-d4ea6196c997 req-08e79d75-ed79-4e2e-94a1-41c6e5df9dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0058bb72-4d0a-4cd2-ace4-549ebc5f018c", "tag": "ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:43.314796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:43.315795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:43.316991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:43.318807 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:43.319807 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:43.320411 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e076fadb-1b54-4e7b-9f96-d4ea6196c997 req-08e79d75-ed79-4e2e-94a1-41c6e5df9dff service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:43.320891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e076fadb-1b54-4e7b-9f96-d4ea6196c997 req-08e79d75-ed79-4e2e-94a1-41c6e5df9dff service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:43.321319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e076fadb-1b54-4e7b-9f96-d4ea6196c997 req-08e79d75-ed79-4e2e-94a1-41c6e5df9dff service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:43.323088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:43.323949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:43.333576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-e076fadb-1b54-4e7b-9f96-d4ea6196c997 req-08e79d75-ed79-4e2e-94a1-41c6e5df9dff service nova] Creating event network-changed:ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2 for instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c on hv-cinder-81558 Aug 05 05:13:43.339381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-e076fadb-1b54-4e7b-9f96-d4ea6196c997 req-08e79d75-ed79-4e2e-94a1-41c6e5df9dff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034217 Aug 05 05:13:43.340408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 36/75] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:43.488882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:43.497089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:43.498605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:43.499703 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dbeda120-578e-4bf7-a209-a63df2eab8e1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.201741 Aug 05 05:13:43.509287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 40/76] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:43 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:44.051317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:44.053966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:44.066932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.068267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.069873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.071351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.072930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.073808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.107224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:44.108602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:44.115681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.116195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.116895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.119150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.120525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.121133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.346272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:44.365945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-db3f6529-a508-4ddb-8849-54a14dd5354e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.322770 Aug 05 05:13:44.371678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 37/77] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:44 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:44.376686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:44.377065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:44.400868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.402801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.403730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.406799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.407270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.408551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.434948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:44.446684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7426a8ae-f4db-4c89-ab22-ed0b00a0a06b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.345371 Aug 05 05:13:44.447399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 41/78] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:44 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:44.530934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:44.531744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:44.537911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.538403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.538830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.539515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:44.539999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:44.540771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:44.580400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:44.588328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4910f048-6623-4271-9e45-0452242bde22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.215513 Aug 05 05:13:44.588908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 38/79] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:44 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:44.738791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:44.747798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:44.749303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:44.750410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-995c0ac2-9a74-4e3c-8b98-67dc5c386509 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.223673 Aug 05 05:13:44.750956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 42/80] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:44 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:13:45.390264 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:45.391045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:45.403589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:45.407344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:45.407886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:45.409110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:45.410698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:45.411609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:45.474784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:45.475747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:45.484249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:45.484842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:45.485288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:45.486226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:45.486675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:45.487096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:45.819626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:45.834976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2e4c3080-be66-495d-8a7c-353f495a9e5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.449844 Aug 05 05:13:45.836163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 39/81] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:45 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:45.842258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:45.843076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:45.850484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:45.851833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:45.851833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:45.852432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:45.852999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:45.853519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:45.963822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:45.974106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-182ec163-f56c-4f3d-b245-6b9974808a88 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.505550 Aug 05 05:13:45.980003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 43/82] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:45 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:45.985978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:45.988502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:46.014979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:46.026534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:46.029227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:46.030112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:46.031624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:46.032306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:46.477943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:46.492985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-85232644-6cb9-4321-88e4-2554de915cff tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.653467 Aug 05 05:13:46.493828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 40/83] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:45 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:46.716747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:46.725920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:46.727637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:46.728910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ba1a3aca-337e-4a8a-a31f-c6fd9b7b1725 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.747697 Aug 05 05:13:46.729649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 44/84] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:45 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:46.856335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:46.856870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:46.862828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:46.863626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:46.864311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:46.865059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:46.865731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:46.866335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:46.995927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:46.996719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:47.008062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:47.012035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:47.012766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:47.015229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:47.015721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:47.016180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:47.034809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:47.044774 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0780aa0c-891b-416d-82c1-b2e3a72a88ff tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.192306 Aug 05 05:13:47.061167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 41/85] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:46 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:47.295478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:47.304405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9ca34011-dba2-40a5-889f-f9cfc3b80414 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.313213 Aug 05 05:13:47.316566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 45/86] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:46 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:47.514389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:47.515065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:47.522243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:47.522740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:47.523171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:47.524186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:47.524651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:47.525237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:47.670177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:47.677961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-095a8e14-56ce-4eb4-9d33-531c1fc512f8 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.167737 Aug 05 05:13:47.678946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 42/87] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:47 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:47.752044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:47.753041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:47.760499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:47.760979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:47.762057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:47.762764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:47.763513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:47.763968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:47.910689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:47.923097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:47.925929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:47.928488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7bcd6cd3-66e4-46c6-ba7e-f909735b698a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.180024 Aug 05 05:13:47.929558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 46/88] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:47 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:48.070484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:48.071095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:48.080327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.081378 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.082408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.084591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.085064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.085705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.260713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:48.269755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4e9edf26-39af-4fee-b2e9-7965c789530e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.202976 Aug 05 05:13:48.270923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 43/89] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:48 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:48.325781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:48.326446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:48.332706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.333263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.333683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.334365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.334804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.339198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.484574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:48.492664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ff323973-bea1-48d7-9307-c490358b8f74 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.171025 Aug 05 05:13:48.493398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 47/90] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:48 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:48.700675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:48.701600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:48.709876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.713138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.713581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.714364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.714720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.715134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.957315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:48.958001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:48.964560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.965040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.965697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.967263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:48.967955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:48.968575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:48.990892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:49.024104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:49.081637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:49.093277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2074ab9f-09d0-4a04-a1ac-3e9c6ded97dc tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.397283 Aug 05 05:13:49.094517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 44/91] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:48 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:49.172440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:49.182069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:49.183628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:49.184875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-978355e2-0515-466e-9588-5ab514aecf65 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.237445 Aug 05 05:13:49.186260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 48/92] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:48 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:49.292895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:49.294151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:49.302814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:49.303330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:49.304013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:49.304807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:49.305268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:49.305781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:49.514550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:49.516023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:49.517613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:49.523968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:49.524966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:49.525592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:49.526381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:49.526945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:49.527060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-408154ea-9ddc-480b-a2cf-093ff0570aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.240197 Aug 05 05:13:49.527470 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:49.527578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 45/93] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:49 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:49.668674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:49.676298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6664b3b1-bc44-4144-90fe-c9d011375133 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.166418 Aug 05 05:13:49.677053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 49/94] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:49 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:50.114599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:50.115233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:50.121500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.121968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.122418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.123109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.123599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.124137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.209880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:50.210494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:50.216823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.217526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.217933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.219239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.219930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.220355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.257251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:50.266279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-da30c98f-9fa0-4eff-bb76-66b9d3fccc22 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.155723 Aug 05 05:13:50.267168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 46/95] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:50 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:50.356320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:50.364464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:50.365976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:50.367070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-660a7ae8-a816-4912-bca7-94d0fc7331b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.161228 Aug 05 05:13:50.367613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 50/96] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:50 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:50.553623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:50.554237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:50.560318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.560806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.561241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.561931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.562379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.562798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.697644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:50.698271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:50.705253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.706120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.706867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.708087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:50.708767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:50.709423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:50.714753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:50.723847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2f8eca09-068b-4de9-a949-cbb40b21fd8b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.174224 Aug 05 05:13:50.729093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 47/97] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:50 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:50.869140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:50.877334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ec12e548-60c4-445f-b922-2b51f44dacbd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.183653 Aug 05 05:13:50.878129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 51/98] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:50 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:51.288582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:51.289739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:51.295668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.296191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.296623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.297335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.297779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.298198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.389726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:51.390319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:51.396278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.396752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.397368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.398051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.398485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.399074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.431023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:51.439357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f1b67aa4-caac-4cb9-9cb0-05b1f1d5fc6f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.154650 Aug 05 05:13:51.440464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 48/99] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:51 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:51.683215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:51.724166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:51.727313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:51.729107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1355d70c-f8b3-46b2-af70-220983bda8dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.343123 Aug 05 05:13:51.729916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 52/100] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:51 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:51.751025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:51.751906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:51.761113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.761836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.762474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.763408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.767122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.767963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.773226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:51.898008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:51.898613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:51.900493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:51.906086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.906565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.906986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.907695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:51.908192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:51.908803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:51.911187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:51.919029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3d032afd-95fd-4487-8bc8-73905267dde7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.172684 Aug 05 05:13:51.919609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 49/101] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:51 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:52.046291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:52.053918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-479a6937-da08-4941-b4e2-2c3d8d2284a0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.159876 Aug 05 05:13:52.054488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 53/102] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:51 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:52.460802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:52.462174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:52.468683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:52.469588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:52.470557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:52.471592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:52.472232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:52.472945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:52.704428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:52.712476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1268f146-3e31-4b81-bca5-b0d5dc85859a tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.256094 Aug 05 05:13:52.713045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 50/103] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:52 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:52.755169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:52.756034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:52.763581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:52.764233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:52.764726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:52.775895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:52.775895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:52.775895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:52.941065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:52.942337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:52.948951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:52.949975 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:52.950118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:52.951313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:52.952127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:52.952790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:52.958428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:52.968838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:52.977558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:52.982332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c9e884b7-1de3-43d4-b69f-5735dfcb1f68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.230865 Aug 05 05:13:53.007075 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 54/104] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:52 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:53.080117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:53.080117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:53.083148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:53.083728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:53.084303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:53.085086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:53.085629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:53.086134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:53.319889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:53.327382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9d417d76-1637-4bd7-8d8a-8a561f78f6a9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.390835 Aug 05 05:13:53.328305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 51/105] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:52 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:53.364617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:53.372490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7fa5a49f-93bd-4e49-a299-70bfc430aa00 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.301720 Aug 05 05:13:53.385629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 55/106] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:53 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:53.734156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:53.734913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:53.741796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:53.742382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:53.742909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:53.743828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:53.744481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:53.744956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:53.883064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:53.890774 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3571ae3c-42c3-4ef1-896b-696f316f0404 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.161655 Aug 05 05:13:53.891361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 52/107] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:53 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:54.013926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:54.014535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:54.022102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.022586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.023010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.023750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.024221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.024634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.158611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:54.167295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:54.169026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:54.170111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-08f85191-4767-41b2-8e0d-7085cf3bd85b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.160214 Aug 05 05:13:54.170668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 56/108] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:54 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:54.353387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:54.354512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:54.361075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.361731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.362338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.363228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.363684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.364127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.392406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:54.393009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:54.400822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.401305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.401732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.402426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.402871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.403279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.619214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:54.627647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-01d34dc5-1baf-4daf-8e81-bb1d574a9ed9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.279251 Aug 05 05:13:54.628271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 53/109] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:54 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:54.664007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:54.672900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6edf6ac6-6983-4c7a-865c-4c107ad058f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.284208 Aug 05 05:13:54.674014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 57/110] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:54 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:54.912452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:54.913048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:54.921256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.924583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.927272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:54.928322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:54.928986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:54.929534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.058211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-d47c507e-6591-44db-a50d-256f3c9a4187 req-fd0031cd-2fc1-4dae-9109-2aab475c61f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0058bb72-4d0a-4cd2-ace4-549ebc5f018c", "name": "network-vif-plugged", "status": "completed", "tag": "ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:55.073753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d47c507e-6591-44db-a50d-256f3c9a4187 req-fd0031cd-2fc1-4dae-9109-2aab475c61f8 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.074915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d47c507e-6591-44db-a50d-256f3c9a4187 req-fd0031cd-2fc1-4dae-9109-2aab475c61f8 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.076468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d47c507e-6591-44db-a50d-256f3c9a4187 req-fd0031cd-2fc1-4dae-9109-2aab475c61f8 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.091055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-d47c507e-6591-44db-a50d-256f3c9a4187 req-fd0031cd-2fc1-4dae-9109-2aab475c61f8 service nova] Creating event network-vif-plugged:ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2 for instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c on hv-cinder-81558 Aug 05 05:13:55.097080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-d47c507e-6591-44db-a50d-256f3c9a4187 req-fd0031cd-2fc1-4dae-9109-2aab475c61f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114085 Aug 05 05:13:55.098345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 58/111] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:13:55.132833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:55.143849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-338469fc-1911-45f9-9087-192a9ed8535b tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.235769 Aug 05 05:13:55.158182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 54/112] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:54 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:55.193573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:55.194390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:55.200589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.201159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.201745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.202448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.202930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.203351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.401921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:55.411006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:55.412709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:55.413869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d8e6a48f-b637-4a1e-b61c-0c1db021af2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.224849 Aug 05 05:13:55.414442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 59/113] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:55 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:55.654453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:55.655311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:55.663545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.664552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.665793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.666869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.667599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.668420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.699336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:55.700735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:55.722189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.722859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.723470 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.724515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:55.724972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:55.725377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:55.907813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:55.921362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c3564795-58e1-4229-9709-db84526a7852 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.272163 Aug 05 05:13:55.934887 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 55/114] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:55 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:55.946034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:55.953888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-66daa5d3-cc77-4966-a98b-592dc0749fef tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.264263 Aug 05 05:13:55.954697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 60/115] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:55 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:56.169355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:56.170048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:56.177256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.177996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.178569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.179284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.179740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.180236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.351679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:56.359925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a95dc4c0-ee61-4936-8b74-e01173d655a5 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.197185 Aug 05 05:13:56.372905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 56/116] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:56 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:56.437833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:56.438417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:56.445688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.448621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.450367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.451081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.451526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.451982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.713422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:56.726081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:56.728030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:56.729326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-90f07e23-345e-403a-9ef6-92685ca16f74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.296283 Aug 05 05:13:56.742696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 61/117] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:56 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:56.942948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:56.943545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:56.949788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.950280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.950895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.951815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.953773 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.954221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.976713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:56.977646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:56.993970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.994824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.995498 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:56.996660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:56.997344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:56.997855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:57.432549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:57.441380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9a77a7e3-bd0c-46e0-b7b2-67c0ccdde57b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.502490 Aug 05 05:13:57.453831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 57/118] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:56 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:57.467722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff6e938-a58e-4bba-8294-f82b51bc8780", "name": "network-vif-plugged", "status": "completed", "tag": "698c4ba3-9bf4-4e10-8b7a-e178c5935a51"}, {"server_uuid": "13e23597-d90a-46cc-9d83-8c03ce58eb4b", "name": "network-vif-plugged", "status": "completed", "tag": "bacfc5f3-58b7-4ad6-8102-def308053a79"}, {"server_uuid": "81a66383-4727-4bd4-bea6-68c1e9e9f3d0", "name": "network-vif-plugged", "status": "completed", "tag": "f49600d8-fdfd-4eae-a883-09ec80b1d6d3"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:57.478862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:57.479536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:57.480062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:57.480698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:57.491431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e69acfca-c3eb-43dd-a057-758f8c17d7d5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1362 microversion: 2.1 time: 0.518879 Aug 05 05:13:57.502741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:56 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:57.502925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Creating event network-vif-plugged:698c4ba3-9bf4-4e10-8b7a-e178c5935a51 for instance aff6e938-a58e-4bba-8294-f82b51bc8780 on hv-cinder-81558 Aug 05 05:13:57.502925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Creating event network-vif-plugged:bacfc5f3-58b7-4ad6-8102-def308053a79 for instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b on hv-cinder-81558 Aug 05 05:13:57.502925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] Creating event network-vif-plugged:f49600d8-fdfd-4eae-a883-09ec80b1d6d3 for instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 on hv-cinder-81558 Aug 05 05:13:57.506028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:57.507081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:57.514144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:57.514914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:57.515541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:57.516855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:57.517318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:57.517734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:57.521222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-bfd69100-a861-4ae1-b5b1-f7defa7d04da req-2af82377-c12f-4d8d-a74c-576e367ff57d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065463 Aug 05 05:13:57.527360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 58/120] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:57.671009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:57.679275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-94ebf639-738e-4e83-bd9c-93ef9969e9f2 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.180839 Aug 05 05:13:57.679888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 63/121] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:57 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:57.757907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:57.758889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:57.767405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:57.767976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:57.768392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:57.769086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:57.769532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:57.769950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:57.928200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:57.936809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:57.938707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:57.940220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d9a4cedb-cb4b-468c-a473-c365ccb59a8e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.187105 Aug 05 05:13:57.941342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 59/122] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:57 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:58.466731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:58.467481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:58.474237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.474892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.475444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.476447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.476999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.477512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.514288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:58.515021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:58.534788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.535319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.535795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.549935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.550519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.551419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.848516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:58.861724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:58.862465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1a04ee65-6ef7-45d3-8a6b-756825cb783e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.399661 Aug 05 05:13:58.863372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 64/123] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:58 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:58.869508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:58.869806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2560cd80-3b23-4b39-b5c2-2b40eb01facb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1548 microversion: 2.1 time: 0.359283 Aug 05 05:13:58.870429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:58.871043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:58 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1548 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:13:58.877765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.878448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.879047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.880166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.880944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.881740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.896351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:58.896847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:58.902948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.903431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.903897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:58.904585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:58.905033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:58.905444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:59.075405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-491741a0-a039-4fee-acf2-6d417f188376 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182476 Aug 05 05:13:59.076290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 61/125] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:13:58 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:59.078291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:59.082466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:59.085792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:13:59.093363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0cce6d5e-8862-4467-8e9b-8134344b2db9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.228281 Aug 05 05:13:59.094566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 65/126] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:58 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:13:59.103753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:59.115747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:59.120074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:59.120659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:59.121554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:59.122131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:59.122618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:59.294618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:59.304083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:59.306019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:13:59.307348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f9327306-09f3-42cc-bf4b-2ebea74d8c6b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.229847 Aug 05 05:13:59.308631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 62/127] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:13:59 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:13:59.541568 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-10ee9531-ec4f-4d00-ad19-3e6693e27960 req-0a711b1a-9da1-40a1-a856-9511505f2787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "name": "network-vif-plugged", "status": "completed", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:13:59.584583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-10ee9531-ec4f-4d00-ad19-3e6693e27960 req-0a711b1a-9da1-40a1-a856-9511505f2787 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:59.585866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-10ee9531-ec4f-4d00-ad19-3e6693e27960 req-0a711b1a-9da1-40a1-a856-9511505f2787 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:59.586490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-10ee9531-ec4f-4d00-ad19-3e6693e27960 req-0a711b1a-9da1-40a1-a856-9511505f2787 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:59.614300 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-10ee9531-ec4f-4d00-ad19-3e6693e27960 req-0a711b1a-9da1-40a1-a856-9511505f2787 service nova] Creating event network-vif-plugged:fce17f2c-7a6f-4061-9c80-3211fcf7ac05 for instance 5edf8301-151e-4713-83c9-fe12e7517fe0 on hv-cinder-81558 Aug 05 05:13:59.623884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-10ee9531-ec4f-4d00-ad19-3e6693e27960 req-0a711b1a-9da1-40a1-a856-9511505f2787 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087427 Aug 05 05:13:59.630562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 66/128] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:13:59.895622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:13:59.897729 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:13:59.905619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:59.906141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:59.906938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:13:59.907914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:13:59.908653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:13:59.909471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:00.109194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:00.115375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:00.116132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:00.123205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:00.123689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:00.124144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:00.124842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-76d666da-8919-45de-9bf8-2a837f275ade tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.232812 Aug 05 05:14:00.124988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:00.125284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:00.137806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:00.137999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 63/129] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:13:59 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:00.334473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:00.336876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:00.344727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:00.349543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:00.350518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:00.351136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:00.352554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:00.353702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:00.354349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:00.358618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-edd755a8-025b-4172-855f-df9369c5a51d tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.244772 Aug 05 05:14:00.359873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 67/130] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:00 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:00.584577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:00.593580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:00.595092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:00.596250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5958d0aa-62e7-4dd1-bcf9-ce18829b9597 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.269411 Aug 05 05:14:00.596816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 64/131] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:00 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:14:00.808333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-3feb2166-eb37-46d0-96ab-90decf1be094 req-a7c19492-64b9-4423-a8a6-12f8aa169019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0058bb72-4d0a-4cd2-ace4-549ebc5f018c", "tag": "ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:14:00.821581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-3feb2166-eb37-46d0-96ab-90decf1be094 req-a7c19492-64b9-4423-a8a6-12f8aa169019 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:00.822272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-3feb2166-eb37-46d0-96ab-90decf1be094 req-a7c19492-64b9-4423-a8a6-12f8aa169019 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:00.823083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-3feb2166-eb37-46d0-96ab-90decf1be094 req-a7c19492-64b9-4423-a8a6-12f8aa169019 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:00.838560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-3feb2166-eb37-46d0-96ab-90decf1be094 req-a7c19492-64b9-4423-a8a6-12f8aa169019 service nova] Creating event network-changed:ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2 for instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c on hv-cinder-81558 Aug 05 05:14:00.844457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-3feb2166-eb37-46d0-96ab-90decf1be094 req-a7c19492-64b9-4423-a8a6-12f8aa169019 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039839 Aug 05 05:14:00.845922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 68/132] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:14:01.149514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:01.150125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:01.158899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:01.159603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:01.160234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:01.162020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:01.162648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:01.163838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:01.377631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:01.385392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:01.385817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fdc1938d-0550-42b8-9d4b-c6c3082cb710 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.240222 Aug 05 05:14:01.386389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 65/133] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:01 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:01.388500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:01.395287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:01.395819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:01.396471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:01.397854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:01.398451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:01.399017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:01.554209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:01.563165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b70ce9c7-66be-4420-9ed0-4b7dc7e7a2f0 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.186155 Aug 05 05:14:01.564078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:01 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:01.620132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:01.621401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:01.628064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:01.628797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:01.629399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:01.630988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:01.631642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:01.632328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:01.787457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:01.793323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:01.799349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:01.800957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:01.801995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9435428e-5af8-4b78-bf97-b19e0444de43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.187289 Aug 05 05:14:01.802636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 66/135] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:01 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:14:02.405864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:02.407199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:02.413393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:02.413866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:02.414578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:02.415680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:02.416352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:02.416803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:02.567388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:02.575952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-776a59c0-fe0e-479b-8010-4ffdd1ba1c48 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1322 microversion: 2.1 time: 0.173822 Aug 05 05:14:02.576648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 70/136] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:02 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:02.583520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:02.585213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:02.591655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:02.592188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:02.592613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:02.593318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:02.593726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:02.594129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:02.750948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:02.759021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7ba24dde-c186-45ac-836f-a5d7edef1c8f tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1315 microversion: 2.1 time: 0.179364 Aug 05 05:14:02.759847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 67/137] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:02 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:02.824984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:02.825576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:02.831600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:02.832111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:02.832562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:02.833233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:02.833723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:02.834147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:02.970183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:02.978916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:02.980438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:02.981571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-834be01d-4e56-461b-93b2-fee1c992c69c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.160666 Aug 05 05:14:02.982120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 71/138] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:02 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:14:03.600020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:03.601744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:03.611040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:03.613624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:03.614084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:03.614939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:03.615398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:03.615840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:03.744647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:03.752714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ca297be2-5bbf-459f-b368-6946f592b733 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1517 microversion: 2.1 time: 0.157966 Aug 05 05:14:03.753318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 68/139] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:03 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:03.775038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:14:03.777444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:03.779697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=85 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:03.784568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:03.785182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:03.793443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:03.793941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:03.794197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:03.794374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:03.794880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:03.795202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:03.795308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:03.795661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:03.796029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:03.796134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:03.796628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:03.797130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:03.862602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'flavor' on Instance uuid 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:14:03.936229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:03.944634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d70c6444-85e4-43e4-b526-fa08355a96b9 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1502 microversion: 2.1 time: 0.163792 Aug 05 05:14:03.955742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 69/140] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:03 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:03.992716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8d02d5d1-7633-44d7-94a0-99f62c5c6776 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0/action" status: 200 len: 32 microversion: 2.1 time: 0.221935 Aug 05 05:14:03.995977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 72/141] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:14:03 2022] POST /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:14:04.003885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:04.004570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:04.005883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:04.006677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:04.012936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:04.013196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:04.013680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:04.014093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:04.014204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:04.014832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:04.014941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:04.015551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:04.016019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:04.016257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:04.019812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:04.020543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:04.255952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:04.266263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:04.286943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:04.288310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:04.288821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-df4341aa-441a-4fbd-b56e-7ca8511fc6bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.289114 Aug 05 05:14:04.289582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 70/142] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:03 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:04.291628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4aa6f1ce-58b9-4394-a138-7e07c93db19a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.290402 Aug 05 05:14:04.293577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 73/143] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:04 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:14:05.310466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:05.311111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:05.315247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:05.316388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:05.317321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:05.317854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:05.318284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:05.318970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:05.319407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:05.319871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:05.323298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:05.323916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:05.324400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:05.325292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:05.325850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:05.326577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:05.551681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:05.555504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:05.564244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:05.565012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4324c82c-ca26-4ab6-866c-e4014df91133 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.258510 Aug 05 05:14:05.566097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 71/144] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:05 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:05.566583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:05.568870 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a2ad63a3-fc90-4170-8a01-8d51233df980 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.257308 Aug 05 05:14:05.579784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 74/145] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:05 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:14:06.586667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:06.587163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:06.593541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:06.594043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:06.594467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:06.594598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:06.595146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:06.595262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:06.595591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:06.596026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:06.601247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:06.601789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:06.602211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:06.602902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:06.603349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:06.603868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:06.807655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:06.815374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-70ab27c8-a12a-4444-9d5d-260ef23bbc86 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.232950 Aug 05 05:14:06.815746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 72/146] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:06 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:06.822776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:06.834347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:06.835874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:06.837090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c11f8d04-e3c1-4f5d-89da-3120fa6a4140 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.246506 Aug 05 05:14:06.837581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 75/147] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:06 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:14:07.838027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:07.838938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:07.846691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:07.847387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:07.847835 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:07.848673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:07.849266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:07.849680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:07.858767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:07.859508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:07.867675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:07.868679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:07.869632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:07.871759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:07.872410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:07.873043 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:08.133281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:08.139579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:08.143069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:08.145922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:08.147551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ed5f0440-f155-4175-9763-c4811717374f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.292737 Aug 05 05:14:08.148651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 76/148] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:07 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:14:08.152453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3b95efed-1d56-4f02-924b-490cf6238357 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.315927 Aug 05 05:14:08.166685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 73/149] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:07 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:08.709897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56024087-e158-4945-b14c-b1382a33f345"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:14:08.712423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:08.718554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:08.719032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:08.719457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:08.720213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:08.720656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:08.721070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:09.173846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:09.174426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:09.181305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:09.181854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:09.182290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:09.183083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:09.183555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:09.183997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:09.437040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:09.446558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8692bd49-662f-4728-9f29-0e62f39561b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.276752 Aug 05 05:14:09.451438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 74/150] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:09 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:09.466299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:09.467688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:09.477595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:09.479075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:09.479899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:09.481148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:09.481919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:09.483811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:09.538656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8b0bee6f-c526-4f3c-a9c1-15b3cf934d63 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "POST /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.832909 Aug 05 05:14:09.539317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 77/151] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:14:08 2022] POST /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:14:09.654765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:09.663932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:09.665926 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:09.667114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-402b340b-c335-4f6e-a333-56d86e4edbac tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1406 microversion: 2.20 time: 0.214582 Aug 05 05:14:09.667957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 75/152] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:09 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:14:10.471950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:10.473053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:10.485287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:10.487748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:10.488586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:10.500189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:10.500668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:10.501266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:10.690311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:10.691240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:10.703611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:10.704132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:10.704560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:10.705258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:10.705705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:10.706118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:11.003042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:11.021061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cf76e04a-faba-4ca8-80c0-eae2c5bd05e1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.553420 Aug 05 05:14:11.021944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 78/153] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:10 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:11.159202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:11.168015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:11.169519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:11.170704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c70f6244-430f-4501-a490-ab9dd09222d2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1598 microversion: 2.20 time: 0.484663 Aug 05 05:14:11.176875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 76/154] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:14:10 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1598 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:14:11.198175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:11.198668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:11.205048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:11.205792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:11.206449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:11.207356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:11.207915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:11.208506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:11.569951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a9c536b8-07aa-4d18-91d7-03049f1ab3ce tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.375674 Aug 05 05:14:11.570743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 79/155] 10.222.0.30 () {60 vars in 1316 bytes} [Fri Aug 5 05:14:11 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-interface => generated 284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:14:12.044289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:12.045045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:12.054269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:12.055278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:12.055947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:12.056991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:12.057789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:12.058394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:12.277224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:12.293789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b5b60b0c-60c1-4f97-9396-b80806d25526 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.254482 Aug 05 05:14:12.295265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 77/156] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:12 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:12.936109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-f1b501df-07db-4089-97d8-346035fb5ce7 req-5ddb6921-a0f1-4ffc-92c2-82d7d958f2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:14:12.966514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f1b501df-07db-4089-97d8-346035fb5ce7 req-5ddb6921-a0f1-4ffc-92c2-82d7d958f2a9 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:12.967494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f1b501df-07db-4089-97d8-346035fb5ce7 req-5ddb6921-a0f1-4ffc-92c2-82d7d958f2a9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:12.967940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f1b501df-07db-4089-97d8-346035fb5ce7 req-5ddb6921-a0f1-4ffc-92c2-82d7d958f2a9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:12.988737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-f1b501df-07db-4089-97d8-346035fb5ce7 req-5ddb6921-a0f1-4ffc-92c2-82d7d958f2a9 service nova] Creating event network-changed:fce17f2c-7a6f-4061-9c80-3211fcf7ac05 for instance 5edf8301-151e-4713-83c9-fe12e7517fe0 on hv-cinder-81558 Aug 05 05:14:12.996566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-f1b501df-07db-4089-97d8-346035fb5ce7 req-5ddb6921-a0f1-4ffc-92c2-82d7d958f2a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065065 Aug 05 05:14:12.997523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 80/157] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:14:13.320425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:13.321883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:13.332120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:13.333309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:13.337972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:13.352280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:13.352942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:13.353479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:13.733802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:13.742419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a95625dd-7c0b-4983-accb-f7e5cca6c7a1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.427458 Aug 05 05:14:13.752463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 78/158] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:13 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:14.779249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:14.780955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:14.793496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:14.794355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:14.795410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:14.798837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:14.799499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:14.800153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:14.826271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:14.954855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:14.964636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-616e203d-6cde-4ad6-99f9-f66cd0eaaa32 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.190658 Aug 05 05:14:14.965292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 81/159] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:14 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:15.990487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:15.991313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:15.999057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=85 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:16.003357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:16.004139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:16.004663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:16.005930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:16.006580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:16.007148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:16.250127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:16.259854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f05ca87c-dadc-442f-be2d-9af06be8385c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.274621 Aug 05 05:14:16.260459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 79/160] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:15 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:17.281345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:17.281946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:17.288546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:17.289100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:17.290318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:17.291103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:17.291553 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:17.292152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:17.497377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:17.510596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ad9f5ff9-2b38-44bb-997a-8871a7e3d047 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.233347 Aug 05 05:14:17.513286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 82/161] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:17 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:18.545867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:18.546503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:18.558614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:18.561392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:18.562799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:18.567386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:18.569393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:18.571244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:18.728991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:18.737512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8814d94e-c7e6-4800-8732-cef179f5de02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.204988 Aug 05 05:14:18.751784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 80/162] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:18 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:19.759878 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:19.761461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:19.772165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:19.774111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:19.774849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:19.775927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:19.776733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:19.777588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:19.932708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:19.941011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-87163c6e-1da0-4b15-b784-53de9760597e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.186299 Aug 05 05:14:19.941656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 83/163] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:19 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:20.616599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:20.617275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:20.623983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:20.624422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:20.624874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:20.625560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:20.626223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:20.626795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:20.659597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:14:20.761355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:20.811127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fb4ddf2f-a8be-4ca2-a0d4-a65aa23745eb tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "DELETE /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 204 len: 0 microversion: 2.1 time: 0.197299 Aug 05 05:14:20.815835 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 81/164] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:14:20 2022] DELETE /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:14:20.821884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:20.824316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:20.838426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:20.839218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:20.839809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:20.841932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:20.842660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:20.843224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:20.963156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:20.963881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:20.970273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:20.971079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:20.971879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:20.973189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:20.973774 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:20.974397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:21.120565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:21.141685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6ea87485-ad83-47dd-8b13-9c4ba4c865ce tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1554 microversion: 2.1 time: 0.324380 Aug 05 05:14:21.142793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 84/165] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:20 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1554 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:21.181225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:21.189832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-80222da1-633a-44ac-b384-6599d9613734 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.231146 Aug 05 05:14:21.190951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 82/166] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:20 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:22.166958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:22.168363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:22.175188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:22.175863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:22.176430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:22.177425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:22.178010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:22.178693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:22.210597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:22.211306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:22.219255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:22.220476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:22.220919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:22.221630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:22.222115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:22.222531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:22.403398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:22.407743 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:22.412155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1530593a-77c3-43db-907f-e5f163d0767c tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1554 microversion: 2.1 time: 0.249564 Aug 05 05:14:22.412813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 85/167] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:22 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:22.415801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f15c857b-9280-4b33-90e6-c5334a1d37ac tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.209134 Aug 05 05:14:22.416381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 83/168] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:22 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:23.435614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:23.436300 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:23.436634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:23.437299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:23.446441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:23.447127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:23.448089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:23.448891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:23.449403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:23.449928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:23.450125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:23.450599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:23.451032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:23.451731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:23.452209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:23.452631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:23.735730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:23.746078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2752618f-4c6f-45ba-99b7-0eefa3057cac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1554 microversion: 2.1 time: 0.314330 Aug 05 05:14:23.746673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 86/169] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:23 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:23.794037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:23.801804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-da8cec28-c40a-40bc-ba8e-3087053ed24d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.369552 Aug 05 05:14:23.802460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 84/170] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:23 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:24.303836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-cfa58733-7c99-4520-a42b-92fa249e125c req-439e958f-0501-4ac6-9f30-aae27a3a3798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e23597-d90a-46cc-9d83-8c03ce58eb4b", "name": "network-vif-deleted", "tag": "bacfc5f3-58b7-4ad6-8102-def308053a79"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:14:24.328558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-cfa58733-7c99-4520-a42b-92fa249e125c req-439e958f-0501-4ac6-9f30-aae27a3a3798 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:24.330034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-cfa58733-7c99-4520-a42b-92fa249e125c req-439e958f-0501-4ac6-9f30-aae27a3a3798 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:24.330662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-cfa58733-7c99-4520-a42b-92fa249e125c req-439e958f-0501-4ac6-9f30-aae27a3a3798 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:24.345394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-cfa58733-7c99-4520-a42b-92fa249e125c req-439e958f-0501-4ac6-9f30-aae27a3a3798 service nova] Creating event network-vif-deleted:bacfc5f3-58b7-4ad6-8102-def308053a79 for instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b on hv-cinder-81558 Aug 05 05:14:24.352262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-cfa58733-7c99-4520-a42b-92fa249e125c req-439e958f-0501-4ac6-9f30-aae27a3a3798 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052661 Aug 05 05:14:24.352965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 87/171] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:14:24.771302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:24.773511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:24.781754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:24.782508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:24.783166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:24.784730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:24.785520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:24.786374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:24.826313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:24.828845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:24.852239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:24.852239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:24.852239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:24.852239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:24.852584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:24.852584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:24.977859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28432f2e1dea486cb163fa2dab6e443f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e98cefc4d147bba944a1cf82f2e772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:24.998267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-609b6f16-852c-40ee-9855-b75e832af465 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 200 len: 1346 microversion: 2.1 time: 0.232474 Aug 05 05:14:25.000395 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 85/172] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:24 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:25.111003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:25.120520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d813c5b2-be0c-4586-99b9-1ba848bd0233 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.300703 Aug 05 05:14:25.123814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 88/173] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:24 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:26.026741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:26.028186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:26.035452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:26.036272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:26.037044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:26.038231 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:26.038938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:26.039527 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:26.058029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] HTTP exception thrown: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Request method failure captured: Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b HTTP/1.1 Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KbusdmZTRNG0rNcWqNxd-dyBJJGgRnp1a4lZ-T7P-wuSaoQN4EU-MdJ06EY5AROJ8Qkn6TCrU427AaBE_Fo6zPobvd7vwtdhOU6fU2laF4bqPciHx29QuIrhRhl4WoXnvxf28wHqF118bJWjLHGlSdPPh54AddiwfOKBcd_hXXpW4A Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:14:26.063420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e98cefc4d147bba944a1cf82f2e772", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 28432f2e1dea486cb163fa2dab6e443f Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.064874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '13e23597-d90a-46cc-9d83-8c03ce58eb4b'} Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:14:26.065533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.066603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.068730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Returning 404 to user: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:14:26.068730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-89d8d925-f5d9-40ac-8763-869421e3caac tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 404 len: 111 microversion: 2.1 time: 0.044358 Aug 05 05:14:26.068730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 86/174] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:26 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:14:26.142862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:26.143465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:26.151408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:26.153041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:26.154199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:26.155146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:26.155596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:26.156890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:26.210653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:26.213002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:26.237475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:26.237978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:26.238500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:26.239106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:26.242188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:26.242699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:26.275575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] HTTP exception thrown: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Request method failure captured: Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b/os-volume_attachments HTTP/1.1 Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KbusdmZTRNG0rNcWqNxd-dyBJJGgRnp1a4lZ-T7P-wuSaoQN4EU-MdJ06EY5AROJ8Qkn6TCrU427AaBE_Fo6zPobvd7vwtdhOU6fU2laF4bqPciHx29QuIrhRhl4WoXnvxf28wHqF118bJWjLHGlSdPPh54AddiwfOKBcd_hXXpW4A Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:14:26.282921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e98cefc4d147bba944a1cf82f2e772", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 28432f2e1dea486cb163fa2dab6e443f Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.284234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'server_id': '13e23597-d90a-46cc-9d83-8c03ce58eb4b'} Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:14:26.284912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:26.286099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:26.288229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Returning 404 to user: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:14:26.289179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2e8fabff-99ec-4274-807a-97cad8d30902 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.083892 Aug 05 05:14:26.293790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 87/175] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:14:26 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b/os-volume_attachments => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:14:26.380207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:26.390701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-24396f93-ab93-430b-9b3c-3106591776aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.251901 Aug 05 05:14:26.402050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 89/176] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:26 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:27.411378 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:27.412018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:27.419095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:27.419575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:27.420050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:27.420732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:27.421171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:27.421616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:27.566856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:27.576471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7cbc8056-da5b-445b-8db4-a1a76291ed40 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.168963 Aug 05 05:14:27.577570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 88/177] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:27 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:27.593988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:27.594488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:27.600939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:27.601473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:27.601902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:27.602580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:27.603030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:27.603441 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:27.616660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] HTTP exception thrown: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Request method failure captured: Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: DELETE /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b HTTP/1.1 Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KbusdmZTRNG0rNcWqNxd-dyBJJGgRnp1a4lZ-T7P-wuSaoQN4EU-MdJ06EY5AROJ8Qkn6TCrU427AaBE_Fo6zPobvd7vwtdhOU6fU2laF4bqPciHx29QuIrhRhl4WoXnvxf28wHqF118bJWjLHGlSdPPh54AddiwfOKBcd_hXXpW4A Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:14:27.621567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e98cefc4d147bba944a1cf82f2e772", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 28432f2e1dea486cb163fa2dab6e443f Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.622971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '13e23597-d90a-46cc-9d83-8c03ce58eb4b'} Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:14:27.623805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.625125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.626810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Returning 404 to user: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:14:27.626810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c5116067-de6f-4cfb-b5b7-76bec42d0c38 tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "DELETE /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 404 len: 111 microversion: 2.1 time: 0.037837 Aug 05 05:14:27.626810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 90/178] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:14:27 2022] DELETE /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:14:27.633207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:27.634053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] [instance: 13e23597-d90a-46cc-9d83-8c03ce58eb4b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:27.640191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:27.640772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:27.641457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:27.642218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:27.642739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:27.643254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:27.657228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] HTTP exception thrown: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Request method failure captured: Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b HTTP/1.1 Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KbusdmZTRNG0rNcWqNxd-dyBJJGgRnp1a4lZ-T7P-wuSaoQN4EU-MdJ06EY5AROJ8Qkn6TCrU427AaBE_Fo6zPobvd7vwtdhOU6fU2laF4bqPciHx29QuIrhRhl4WoXnvxf28wHqF118bJWjLHGlSdPPh54AddiwfOKBcd_hXXpW4A Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:14:27.666334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e98cefc4d147bba944a1cf82f2e772", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e98cefc4d147bba944a1cf82f2e772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 08e98cefc4d147bba944a1cf82f2e772 Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-DeleteServersTestJSON-2033679596 Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 28432f2e1dea486cb163fa2dab6e443f Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-DeleteServersTestJSON-2033679596-project Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '13e23597-d90a-46cc-9d83-8c03ce58eb4b'} Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:14:27.669056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. Aug 05 05:14:27.670359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:14:27.671986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] Returning 404 to user: Instance 13e23597-d90a-46cc-9d83-8c03ce58eb4b could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:14:27.671986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f6041390-5aa7-4d6e-9a5f-8c10d58b6adf tempest-DeleteServersTestJSON-2033679596 tempest-DeleteServersTestJSON-2033679596-project] 10.222.0.30 "GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b" status: 404 len: 111 microversion: 2.1 time: 0.031995 Aug 05 05:14:27.671986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 89/179] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:27 2022] GET /compute/v2.1/servers/13e23597-d90a-46cc-9d83-8c03ce58eb4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:14:28.600719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:28.601544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:28.608914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:28.609699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:28.610142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:28.610887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:28.611325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:28.611744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:28.788924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:28.806872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c2b789e2-a1b9-4c79-8ac9-e046873ac5da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.212430 Aug 05 05:14:28.821389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 91/180] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:28 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:14:29.831119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:29.831932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:29.839563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:29.840367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:29.841022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:29.841968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:29.842568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:29.843150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:30.038383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:30.048983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-80f97a1a-666a-4c3f-b390-517024ea8af9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.221989 Aug 05 05:14:30.050455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 90/181] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:29 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:31.076955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:31.077696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:31.086303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:31.087070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:31.087679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:31.088709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:31.090110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:31.090741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:31.610490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:31.620154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3cdbc5bf-8ed3-4d9e-a9a1-2b14349f2a8c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.547923 Aug 05 05:14:31.621074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 92/182] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:31 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:32.643340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:32.644625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:32.651470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:32.652355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:32.652988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:32.654043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:32.654704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:32.655317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:32.825100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:32.840537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2860bc71-c704-40fd-ad08-a78bb2860879 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.201042 Aug 05 05:14:32.841663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 91/183] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:32 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:33.862841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:33.863469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:33.866226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=42 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:33.872142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:33.872804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:33.873462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:33.874235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:33.874841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:33.875451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:34.042127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:34.062171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f65b7015-a021-4b6b-bf53-f8090e8ef9d1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.202489 Aug 05 05:14:34.062984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 93/184] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:33 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:35.082780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:35.083388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:35.089800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:35.090281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:35.090706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:35.091387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:35.091849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:35.092279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:35.232255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:35.242538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6471a800-8ec9-4fe9-a08c-361ab2dae80e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.163693 Aug 05 05:14:35.243109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 92/185] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:35 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:36.269770 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:36.270628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:36.281817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:36.282602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:36.283317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:36.284524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:36.285273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:36.285987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:36.421934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:36.429509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-db3718b3-be16-434e-a6b5-2f26dd3f6dd1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.166420 Aug 05 05:14:36.430047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 94/186] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:36 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:37.454784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:37.455926 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:37.464489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:37.464996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:37.465423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:37.466109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:37.466552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:37.466966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:37.602434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:37.610660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f7a82b22-6d53-4587-8a39-dcb71d7fcfb2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.162682 Aug 05 05:14:37.611208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 93/187] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:37 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:38.635195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:38.636199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:38.646242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:38.646977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:38.647843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:38.649085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:38.649884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:38.650521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:38.785431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:38.793509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0a2dbeec-d480-4af1-aaf2-422b43af72b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.164361 Aug 05 05:14:38.794071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 95/188] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:38 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:39.816289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:39.816900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:39.824357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:39.824879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:39.825346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:39.826126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:39.826647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:39.827123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:39.971644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:39.979815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-04a7f32d-de77-439c-b404-e6f74e6ddb33 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.169447 Aug 05 05:14:39.980377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 94/189] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:39 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:41.002117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:41.002713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:41.009073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:41.009584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:41.010010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:41.010702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:41.011142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:41.011580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:41.148116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:41.156078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7af1a307-f2d2-4676-8fec-ff1f4dd7865f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.158595 Aug 05 05:14:41.156638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 96/190] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:40 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:42.179638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:42.181210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:42.188103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:42.188710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:42.189399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:42.190299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:42.190955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:42.191490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:42.340033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:42.350369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-53112abd-a22b-4619-9725-f9d4cd5b56c7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.175156 Aug 05 05:14:42.350956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 95/191] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:42 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:43.372565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:43.373361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:43.379728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:43.380241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:43.380677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:43.381366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:43.381813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:43.382237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:43.549344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:43.557288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-246865b5-b64d-4250-8f80-66348ad3a8b8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.189210 Aug 05 05:14:43.557994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 97/192] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:43 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:44.577853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:44.578552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:44.584663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:44.585228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:44.585731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:44.586425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:44.586875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:44.587296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:44.746278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:44.753618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4f2b9aa4-c002-4d62-a579-8ca78c1947a7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.179613 Aug 05 05:14:44.757402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 96/193] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:44 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:45.779624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:45.780571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:45.790118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:45.790776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:45.791389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:45.792400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:45.793173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:45.793593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:45.796220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=91 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:45.929266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:45.937062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-59e160e0-6cc7-4ec4-9705-a2dbc68e73a6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.162964 Aug 05 05:14:45.937879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 98/194] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:45 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:46.965059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:46.965670 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:46.967789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:46.973080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:46.973559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:46.973994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:46.974744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:46.975199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:46.975618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:47.103690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:47.111327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-086d143b-9610-490a-a414-cf36203fa626 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.153053 Aug 05 05:14:47.111915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 97/195] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:46 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:48.136486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:48.137306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:48.144191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:48.144675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:48.145107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:48.145790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:48.146235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:48.146656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:48.279227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:48.286883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7d6c183d-23d0-44fd-935f-1953dbb9276c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.157040 Aug 05 05:14:48.287439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 99/196] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:48 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:49.308387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:49.309038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:49.315550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:49.316070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:49.316506 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:49.317191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:49.317663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:49.318034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:49.452124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:49.459943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b899ca44-350e-4f76-a136-7a08ec1aa31e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.155520 Aug 05 05:14:49.460579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 98/197] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:49 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:50.484704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:50.485420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:50.493866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:50.494460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:50.495002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:50.495885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:50.496437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:50.496983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:50.630162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:50.637720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f99c0f91-24a7-45d1-8471-59305bc4939e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.159221 Aug 05 05:14:50.638286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 100/198] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:50 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:51.660207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:51.660764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:51.667707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:51.668251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:51.668680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:51.669399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:51.669849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:51.670372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:51.672917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=91 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:14:51.805308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:51.817492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-06f709e8-04ab-4a64-8e8f-629208ae7bc0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.161153 Aug 05 05:14:51.818352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 99/199] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:51 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:52.844012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:52.844601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:52.851911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:52.852417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:52.852825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:52.853510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:52.853959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:52.854377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:52.993191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:53.004566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a53a371a-f141-453a-86e1-340246b40735 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.166314 Aug 05 05:14:53.005164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 101/200] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:52 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:54.025826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:54.026445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:54.032461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:54.032942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:54.033372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:54.034036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:54.034671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:54.035109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:54.214251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:54.222003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-09944796-764d-4264-856d-b6c0d4ad3884 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.200103 Aug 05 05:14:54.222571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 100/201] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:54 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:55.242464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:55.243062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:55.249825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:55.250339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:55.250792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:55.251478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:55.251980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:55.252414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:55.406303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:55.415705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4fb50cfe-4560-4a33-a06b-3db720454f29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.177127 Aug 05 05:14:55.416607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 102/202] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:55 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:56.439190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:56.439878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:56.447093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:56.447582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:56.448053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:56.449041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:56.449487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:56.449900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:56.584495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:56.599571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bc186162-c8e6-45ea-919e-13cde412eb8d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1523 microversion: 2.1 time: 0.157871 Aug 05 05:14:56.599571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 101/203] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:56 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:56.698457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1967662541", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:14:56.751170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] validate_networks() for None {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:14:57.023473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:14:57.023957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:14:57.024695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:14:57.024828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:14:57.025234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:14:57.034351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:57.034824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:57.035255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:57.036077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:57.036468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:57.036884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:57.054126 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Getting quotas for project f4e5e9d10a8e4d98b6dfff10362f5e8d. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:14:57.057598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Getting quotas for user c3e88a4234f64c3b95f313a0355f0b81 and project f4e5e9d10a8e4d98b6dfff10362f5e8d. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:14:57.068785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:14:57.071061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:14:57.118070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-910987ee-5db5-4547-a4c1-b9327b5a19e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423465 Aug 05 05:14:57.118707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 103/204] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:14:57.129557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ee95f6ad-50c2-409c-be71-e7566696a5bb tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:57.130167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ee95f6ad-50c2-409c-be71-e7566696a5bb tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:57.186921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ee95f6ad-50c2-409c-be71-e7566696a5bb tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:57.195070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ee95f6ad-50c2-409c-be71-e7566696a5bb tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1215 microversion: 2.1 time: 0.069354 Aug 05 05:14:57.195858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 102/205] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:57 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:57.619412 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:57.620057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:57.627933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:57.628580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:57.629176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:57.630020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:57.630621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:57.631242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:57.783307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:57.793494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c8ae8f7f-7972-460e-ab9e-4074a388789e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1503 microversion: 2.1 time: 0.183291 Aug 05 05:14:57.796537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 104/206] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:57 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:57.817779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:57.818343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:57.825448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:57.825991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:57.826596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:57.827321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:57.827949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:57.829006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:58.023821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:58.032496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e78e7b60-8ca8-4940-84e6-ff1fef85f42a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1514 microversion: 2.1 time: 0.219227 Aug 05 05:14:58.033223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 103/207] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:57 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:58.217984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:58.218787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:58.225686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:58.226243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:58.226742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:58.227501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:58.227983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:58.228406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:58.293558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:58.301495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-98e17581-1525-44d9-afd4-2858f9a9505d tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1267 microversion: 2.1 time: 0.088933 Aug 05 05:14:58.302073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 105/208] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:58 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:14:59.324668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:14:59.325259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:14:59.332557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:59.333048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:59.333477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:59.334183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:14:59.334625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:14:59.335037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:14:59.407039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:14:59.415828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0a15a0d0-a484-4938-888e-6235d2cbeff1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1267 microversion: 2.1 time: 0.095114 Aug 05 05:14:59.416403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 104/209] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:14:59 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:00.442869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:00.443858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:00.455119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:00.455922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:00.456814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:00.457338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:00.457856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:00.458404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:00.523928 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:00.531419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6c05f8c-c4c1-4c13-a89b-62ea4594e0d1 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1267 microversion: 2.1 time: 0.095062 Aug 05 05:15:00.532013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 106/210] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:00 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:01.553162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:01.553912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:01.560978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:01.561460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:01.561887 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:01.562578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:01.563021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:01.563436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:01.635567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:01.643880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ad459fa0-e21d-48de-80d4-b0c98e75cb14 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1285 microversion: 2.1 time: 0.094799 Aug 05 05:15:01.644451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 105/211] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:01 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:02.675243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:02.675864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:02.683261 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:02.683750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:02.684207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:02.684907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:02.685352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:02.685768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:02.689357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:02.694191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:02.700466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:02.701076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:02.701845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:02.702851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:02.703474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:02.704114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:02.727967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'flavor' on Instance uuid aff6e938-a58e-4bba-8294-f82b51bc8780 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:15:02.835215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:02.847752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-686d643d-0a1d-467e-a78a-a5fc4bfcbf0b tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.177413 Aug 05 05:15:02.848813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 107/212] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:02 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:02.903352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-79b2b5f1-315e-4e5d-b32e-255387f49b9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/action" status: 200 len: 32 microversion: 2.1 time: 0.228860 Aug 05 05:15:02.904138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 106/213] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:15:02 2022] POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 05 05:15:02.914125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:02.915091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:02.921784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:02.922272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:02.922814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:02.923955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:02.924661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:02.925317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:03.112225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-7e76a0ff-6a91-412c-bb26-4e31cc321e9f req-03a87939-fd95-43f2-a23c-4725b6684bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7af4535-7c35-4c8c-acd6-138aa8f57ed3", "tag": "7c3a562f-32f2-40e2-8fd4-03b7e04bbd76"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:03.125841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7e76a0ff-6a91-412c-bb26-4e31cc321e9f req-03a87939-fd95-43f2-a23c-4725b6684bf9 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:03.126951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7e76a0ff-6a91-412c-bb26-4e31cc321e9f req-03a87939-fd95-43f2-a23c-4725b6684bf9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:03.127703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7e76a0ff-6a91-412c-bb26-4e31cc321e9f req-03a87939-fd95-43f2-a23c-4725b6684bf9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:03.140430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-7e76a0ff-6a91-412c-bb26-4e31cc321e9f req-03a87939-fd95-43f2-a23c-4725b6684bf9 service nova] Creating event network-changed:7c3a562f-32f2-40e2-8fd4-03b7e04bbd76 for instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 on hv-cinder-81558 Aug 05 05:15:03.146236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-7e76a0ff-6a91-412c-bb26-4e31cc321e9f req-03a87939-fd95-43f2-a23c-4725b6684bf9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038846 Aug 05 05:15:03.147917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 107/214] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:03.149609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:03.158790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4ab5bce7-eb30-47ff-8326-b933e81fd704 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.248690 Aug 05 05:15:03.159457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 108/215] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:02 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:03.870349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:03.870907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:03.878161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:03.878621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:03.879044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:03.879958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:03.880594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:03.881051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:04.017182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:04.025228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ab94af64-02de-411a-a0cf-885cbaf080e9 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.159304 Aug 05 05:15:04.025873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 108/216] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:03 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:04.180883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:04.181467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:04.183801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:04.189403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:04.189881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:04.190306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:04.190965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:04.191404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:04.191821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:04.330477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:04.338372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-28bd2f4d-0c7d-4268-a741-9c933d2111af tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.161401 Aug 05 05:15:04.338912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 109/217] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:04 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:05.046746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:05.047357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:05.053984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:05.054465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:05.054894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:05.055578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:05.056055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:05.056475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:05.187908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:05.195535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d84cc49f-be0b-4bf4-b1c8-4c67386a2732 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.152741 Aug 05 05:15:05.196266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 109/218] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:05 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:05.359846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:05.360389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:05.367134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:05.367638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:05.368087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:05.368778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:05.369227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:05.369693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:05.498684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:05.506607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3163b451-e9d9-4985-ab62-bb39012cfc35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.150750 Aug 05 05:15:05.507181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 110/219] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:05 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:06.220782 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:06.221611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:06.228095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:06.228574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:06.228997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:06.229675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:06.230108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:06.230526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:06.363244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:06.371235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c89fc4bb-6d21-4d22-84b3-0b64bbe4a1c3 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.157010 Aug 05 05:15:06.371791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 110/220] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:06 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:06.533571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:06.534646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:06.545908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:06.546724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:06.547416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:06.548633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:06.549401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:06.549819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:06.684197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:06.692218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7ad9808d-d978-4398-9d32-7677cb321401 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.166658 Aug 05 05:15:06.692799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 111/221] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:06 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:07.398865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:07.399456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:07.401568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:07.407115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:07.407593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:07.408049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:07.408832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:07.409274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:07.409690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:07.546644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:07.554133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-70d9c5c8-8e36-449e-bdb3-7df5f041c9e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.159241 Aug 05 05:15:07.554696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 111/222] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:07 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:07.717399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:07.718385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:07.721271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:07.722317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:07.733734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:07.734529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:07.735240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:07.736395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:07.737289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:07.738013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:07.871327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:07.881966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1489fefc-f83e-480b-85e1-5caed3cd162d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.171174 Aug 05 05:15:07.884068 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 112/223] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:07 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:08.576261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:08.576850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:08.584494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:08.584974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:08.585403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:08.586096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:08.586532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:08.586947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:08.722265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:08.729993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c568a396-bdce-4fbd-ba59-346950b54bd0 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.158208 Aug 05 05:15:08.730597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 112/224] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:08 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:08.905838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:08.906457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:08.912894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:08.913609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:08.913886 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:08.914836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:08.915273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:08.916075 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:09.086388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:09.094267 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f803cbf6-f753-48d0-b9b8-462bd94842da tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.194138 Aug 05 05:15:09.094747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 113/225] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:08 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:09.750603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:09.751289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:09.758728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:09.759293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:09.759724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:09.760795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:09.761403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:09.761874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:09.905843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:09.913967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-97d09949-d2ad-4013-ad8b-28e9154039e8 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.167216 Aug 05 05:15:09.914904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 113/226] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:09 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:10.115409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:10.117184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:10.126121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:10.127016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:10.127948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:10.129619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:10.130262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:10.130814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:10.311858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:10.319888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9e33bce5-ff94-4576-a90b-cfd3b239760f tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.209072 Aug 05 05:15:10.320632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 114/227] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:10 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:10.935128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:10.937125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:10.944245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:10.945078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:10.945606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:10.947168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:10.947917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:10.948399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:11.113386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:11.121263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a27fa3a8-afdb-4cbd-b372-752c01d461c5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.190217 Aug 05 05:15:11.121836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 114/228] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:10 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:11.345120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:11.345898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:11.352503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:11.353078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:11.353510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:11.354203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:11.355484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:11.356440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:11.373160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:11.513597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:11.521684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f4c30782-323c-402f-be7b-ec1b496e0730 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.184172 Aug 05 05:15:11.522318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 115/229] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:11 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:12.142959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:12.143513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:12.149913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:12.150397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:12.150825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:12.151512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:12.151994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:12.152422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:12.167800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:12.293761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:12.301616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-afaeb129-6290-444c-970f-b5f6257d9cc5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.162730 Aug 05 05:15:12.302177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 115/230] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:12 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:12.547085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:12.548256 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:12.556141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:12.556621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:12.557046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:12.557737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:12.558177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:12.558593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:12.693731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:12.701327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f18936a6-56b5-4d5d-9c77-94f462164b35 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.160809 Aug 05 05:15:12.701866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 116/231] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:12 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:13.326009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:13.326834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:13.337146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:13.337957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:13.338673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:13.339829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:13.340604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:13.341306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:13.476864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:13.484895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6edbb266-992f-4a2f-ba02-bb19fe0fb2e5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.165646 Aug 05 05:15:13.485469 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 116/232] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:13 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:13.726722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:13.727702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:13.738485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:13.739275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:13.740162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:13.740839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:13.741285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:13.741681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:13.878044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:13.886407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-01d940b2-2207-45bb-90b1-edc66b801469 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.166342 Aug 05 05:15:13.886991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 117/233] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:13 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:14.505698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:14.506326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:14.514444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:14.515136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:14.515562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:14.516305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:14.516745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:14.517155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:14.658132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:14.666549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9e08aa1f-67a5-4370-88ec-356f2374ec59 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.164859 Aug 05 05:15:14.667107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 117/234] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:14 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:14.908821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:14.909585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:14.916704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:14.917289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:14.917821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:14.918582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:14.919038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:14.919460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:15.068743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:15.085143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-04800231-4969-4f4d-9330-c6358dcfb4e6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.173101 Aug 05 05:15:15.085143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 118/235] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:14 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:15.687333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:15.687993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:15.694595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:15.695090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:15.695662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:15.696445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:15.696876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:15.697294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:15.834226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:15.843101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-04b03a9e-e077-4e4f-a9b5-9725bf083ca5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.159556 Aug 05 05:15:15.844309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 118/236] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:15 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:16.101041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:16.101746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:16.117431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:16.118013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:16.118512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:16.119278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:16.119800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:16.120650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:16.265941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:16.273638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a65d7d01-a784-4cde-a1aa-f16c22504f51 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.176849 Aug 05 05:15:16.274207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 119/237] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:16 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:16.866093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:16.866831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:16.874829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:16.875354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:16.875936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:16.876787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:16.877356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:16.877875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:16.919063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:16.920106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:16.925851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:16.926417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:16.926940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:16.927694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:16.928294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:16.928764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:16.952346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2622b805-a9c5-4f85-86ec-816f9e67c23b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/ips" status: 200 len: 146 microversion: 2.1 time: 0.037210 Aug 05 05:15:16.953058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 120/238] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:15:16 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:17.010572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:17.018415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-09200cc8-4640-4e49-b6c8-7b8550fdbe55 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.157233 Aug 05 05:15:17.018988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 119/239] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:16 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:17.299069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:17.300115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:17.310319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:17.310800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:17.311228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:17.311946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:17.312390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:17.312804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:17.460919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:17.468778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7ab66d0b-7a1b-4be0-ab5a-ea45cf267aa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.176349 Aug 05 05:15:17.469328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 121/240] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:17 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:18.038719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:18.039780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:18.041859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=48 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:18.047347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:18.047852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:18.048300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:18.048967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:18.049416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:18.049834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:18.187466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:18.195187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ebf25c8b-68f4-4132-9519-87fe49601758 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.160371 Aug 05 05:15:18.196023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 120/241] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:18 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:18.373328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-7440cb7e-a5c7-4986-9ebe-58bb9345918c req-f9738bd8-42ef-46a3-a450-6942141385cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7af4535-7c35-4c8c-acd6-138aa8f57ed3", "name": "network-vif-plugged", "status": "completed", "tag": "7c3a562f-32f2-40e2-8fd4-03b7e04bbd76"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:18.384712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-7440cb7e-a5c7-4986-9ebe-58bb9345918c req-f9738bd8-42ef-46a3-a450-6942141385cc service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:18.385361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-7440cb7e-a5c7-4986-9ebe-58bb9345918c req-f9738bd8-42ef-46a3-a450-6942141385cc service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:18.385850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-7440cb7e-a5c7-4986-9ebe-58bb9345918c req-f9738bd8-42ef-46a3-a450-6942141385cc service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:18.397981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-7440cb7e-a5c7-4986-9ebe-58bb9345918c req-f9738bd8-42ef-46a3-a450-6942141385cc service nova] Creating event network-vif-plugged:7c3a562f-32f2-40e2-8fd4-03b7e04bbd76 for instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 on hv-cinder-81558 Aug 05 05:15:18.403143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-7440cb7e-a5c7-4986-9ebe-58bb9345918c req-f9738bd8-42ef-46a3-a450-6942141385cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Aug 05 05:15:18.403856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 122/242] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:18.496884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:18.497621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:18.504565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:18.505062 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:18.505491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:18.506174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:18.506617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:18.507029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:18.723029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:18.732364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ca0f3482-719e-4b93-94f9-4c530c0f5b94 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.238990 Aug 05 05:15:18.739158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 121/243] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:18 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:19.217670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:19.218372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:19.224776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:19.225231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:19.225690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:19.226373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:19.226811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:19.227227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:19.389689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:19.399275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7e054adb-5303-43de-ab5b-abecff8d62cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1315 microversion: 2.1 time: 0.186566 Aug 05 05:15:19.400061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 123/244] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:19 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:19.758186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:19.759237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:19.769533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:19.770360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:19.771078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:19.772311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:19.773066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:19.773779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:19.986404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:19.994098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-82c3ac61-801b-439e-8bc6-ac86962b6410 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.242564 Aug 05 05:15:19.994681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 122/245] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:19 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:20.435503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:20.436080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:20.442974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.443450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.443916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.444598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.445071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.445476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.587941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5e13868-4708-4a79-b361-555df4226a21"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:20.590433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:20.597608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.598097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.598529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.598879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:20.599224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.599666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.600108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.608598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dd677457-5b0e-428b-ac73-80ac9175d181 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1464 microversion: 2.1 time: 0.177681 Aug 05 05:15:20.610121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 124/246] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:20 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:20.663147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:20.663977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:20.676980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.677514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.678243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.678802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.679501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.680149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.853370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:15:20.944275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-059b9aab-9730-48bb-871a-e63938e1fbe5 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 204 len: 0 microversion: 2.1 time: 0.288332 Aug 05 05:15:20.948280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 125/247] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:15:20 2022] DELETE /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:15:20.954273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:20.955097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:20.961015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.961533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.961964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:20.962647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:20.963094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:20.963506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:21.125480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:21.133955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f522639c-2425-4085-a534-74b2fcd67938 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1470 microversion: 2.1 time: 0.184276 Aug 05 05:15:21.134704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 126/248] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:20 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:21.150161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:21.150764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:21.156998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:21.157505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:21.157932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:21.158816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:21.159432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:21.160014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:21.358056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:21.366678 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6a6b6b18-1e6c-4256-bf4d-5ba125c7b1bc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.220100 Aug 05 05:15:21.367185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 127/249] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:21 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:22.156377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:22.157661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:22.164798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:22.165260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:22.165694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:22.166399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:22.166810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:22.167263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:22.300009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:22.312515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-907bee0a-f74f-4a56-913e-c032d4e5d2cd tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1470 microversion: 2.1 time: 0.160262 Aug 05 05:15:22.313311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 128/250] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:22 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:22.389408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:22.390025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:22.395972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:22.396460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:22.396896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:22.397588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:22.398088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:22.398533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:22.545044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:22.553463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-55692125-0e01-4ccc-a4cb-ddb746e5910c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.168176 Aug 05 05:15:22.554080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 129/251] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:22 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:23.335750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:23.336460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:23.341153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-198f8dd3-cabc-4fcb-9a40-1a87815f3484 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.757111 Aug 05 05:15:23.342313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 123/252] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:15:20 2022] POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-volume_attachments => generated 194 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:15:23.343516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:23.344121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:23.344661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:23.345592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:23.346133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:23.346709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:23.538448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:23.547723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e480c8e0-129e-467c-b715-ed24b4c0a1de tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1470 microversion: 2.1 time: 0.217313 Aug 05 05:15:23.562380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 130/253] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:23 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:23.586504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:23.588421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:23.601773 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:23.602264 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:23.602704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:23.603402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:23.603873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:23.605541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:24.120833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:24.139577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-41ee0b7b-98b9-43a5-992e-d9ccb39bc6f0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.567127 Aug 05 05:15:24.142903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 124/254] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:23 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:24.467874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-4713cfa0-e4f1-4110-a497-f91ff2a15b34 req-3ac44918-cc0f-4f2f-8c6c-18a94f3cd9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7af4535-7c35-4c8c-acd6-138aa8f57ed3", "name": "network-vif-deleted", "tag": "7c3a562f-32f2-40e2-8fd4-03b7e04bbd76"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:24.483193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-4713cfa0-e4f1-4110-a497-f91ff2a15b34 req-3ac44918-cc0f-4f2f-8c6c-18a94f3cd9aa service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:24.484521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-4713cfa0-e4f1-4110-a497-f91ff2a15b34 req-3ac44918-cc0f-4f2f-8c6c-18a94f3cd9aa service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:24.485393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-4713cfa0-e4f1-4110-a497-f91ff2a15b34 req-3ac44918-cc0f-4f2f-8c6c-18a94f3cd9aa service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:24.498112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-4713cfa0-e4f1-4110-a497-f91ff2a15b34 req-3ac44918-cc0f-4f2f-8c6c-18a94f3cd9aa service nova] Creating event network-vif-deleted:7c3a562f-32f2-40e2-8fd4-03b7e04bbd76 for instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 on hv-cinder-81558 Aug 05 05:15:24.505922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-4713cfa0-e4f1-4110-a497-f91ff2a15b34 req-3ac44918-cc0f-4f2f-8c6c-18a94f3cd9aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042830 Aug 05 05:15:24.510627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 131/255] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:15:24.572340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:24.573871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:24.585757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:24.586713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:24.587663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:24.588621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:24.590732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:24.592166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:24.674300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:24.683301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6c4577c6-3501-41de-9034-2116a60942ee tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1428 microversion: 2.1 time: 0.116877 Aug 05 05:15:24.684184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 125/256] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:24 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:25.163427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:25.164783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:25.171295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:25.171898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:25.172418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:25.173175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:25.173690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:25.174206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:25.178987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:25.334571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:25.344817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0598eea8-021f-407e-9bd9-63f6076ff16c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.185633 Aug 05 05:15:25.346512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 132/257] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:25 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:25.705584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:25.706261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:25.716095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:25.718825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:25.719431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:25.720360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:25.722865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:25.723307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:25.763937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:25.764730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:25.765568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:25.766310 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lazy-loading 'fault' on Instance uuid e7af4535-7c35-4c8c-acd6-138aa8f57ed3 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:15:25.816768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:25.826345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a656c4a7-1a38-4a4c-9b4b-a2b577c55c95 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1305 microversion: 2.1 time: 0.125667 Aug 05 05:15:25.827168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 126/258] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:25 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:26.366495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:26.367215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:26.374064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:26.374546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:26.374975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:26.375699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:26.376198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:26.376611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:26.516905 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:26.524671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1816bf3a-dd40-445b-85c2-ac2cbcad0173 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.162063 Aug 05 05:15:26.525236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 133/259] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:26 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:26.848273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:26.849253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:26.855460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:26.856063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:26.856473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:26.857336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:26.857984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:26.858429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:26.892129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:26.892611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:26.893075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:26.893522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lazy-loading 'fault' on Instance uuid e7af4535-7c35-4c8c-acd6-138aa8f57ed3 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:15:26.948033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e88a4234f64c3b95f313a0355f0b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e5e9d10a8e4d98b6dfff10362f5e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:26.955188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5ca521c2-f859-4756-a211-e655a51e5078 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 200 len: 1305 microversion: 2.1 time: 0.110839 Aug 05 05:15:26.955780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 127/260] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:26 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:27.547203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:27.548467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:27.555010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:27.555501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:27.555977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:27.556734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:27.557185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:27.557602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:27.719150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:27.728391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bb63b2cf-eb29-4130-94a7-68f0d89edc0d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.185870 Aug 05 05:15:27.729749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 134/261] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:27 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:27.976702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:27.977082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] [instance: e7af4535-7c35-4c8c-acd6-138aa8f57ed3] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:27.983464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:27.983982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:27.984409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:27.985097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:27.985544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:27.985957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:28.001548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] HTTP exception thrown: Instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 could not be found. Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Request method failure captured: Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 HTTP/1.1 Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KdP_bu50LgDoDVgKVOcEunTGrj-UxUf9JLUf7t5vO9Ztls9tnI8NZrFRvd3gaMIjrZzHYGPIcgQ0VdnZYSdzOGvbXdmecxj09FCwKbmxv6-BTuOy5X1VuGqGD2ku0g4yUKPGE84MM4FYuR-S8BOiyLZemPeWK2_LvQlsq1ujcYGm3k Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: f4e5e9d10a8e4d98b6dfff10362f5e8d Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-VolumesNegativeTest-1461214483 Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:15:28.003241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f4e5e9d10a8e4d98b6dfff10362f5e8d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f4e5e9d10a8e4d98b6dfff10362f5e8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f4e5e9d10a8e4d98b6dfff10362f5e8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f4e5e9d10a8e4d98b6dfff10362f5e8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-VolumesNegativeTest-1461214483 Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: f4e5e9d10a8e4d98b6dfff10362f5e8d Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-VolumesNegativeTest-1461214483 Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-VolumesNegativeTest-1461214483-project Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c3e88a4234f64c3b95f313a0355f0b81 Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-VolumesNegativeTest-1461214483-project Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 could not be found. Aug 05 05:15:28.004669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'e7af4535-7c35-4c8c-acd6-138aa8f57ed3'} Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 could not be found. Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:15:28.005507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 could not be found. Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 could not be found. Aug 05 05:15:28.006870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:28.008104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] Returning 404 to user: Instance e7af4535-7c35-4c8c-acd6-138aa8f57ed3 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:15:28.008104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dc97a0ff-c277-47ea-be2a-6e61afe9ce94 tempest-VolumesNegativeTest-1461214483 tempest-VolumesNegativeTest-1461214483-project] 10.222.0.30 "GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3" status: 404 len: 111 microversion: 2.1 time: 0.032577 Aug 05 05:15:28.008104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 128/262] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:27 2022] GET /compute/v2.1/servers/e7af4535-7c35-4c8c-acd6-138aa8f57ed3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:15:28.749892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:28.750492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:28.761491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:28.762560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:28.764668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:28.765403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:28.765858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:28.766284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:28.945921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:28.957079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1b8fa3f4-bd9e-45d1-adae-6898d378d79d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1500 microversion: 2.1 time: 0.211040 Aug 05 05:15:28.958850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 135/263] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:28 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1500 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:28.982753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ae3c401-5351-4226-b74d-d67c5559418e"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:28.985746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:28.996943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:29.002554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:29.003430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:29.004418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:29.005928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:29.006940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:29.068435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] HTTP exception thrown: Cannot 'attach_volume' instance aff6e938-a58e-4bba-8294-f82b51bc8780 while it is in vm_state rescued Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Request method failure captured: Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/os-volume_attachments HTTP/1.1 Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 74 Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KbulsjSmVXWUZbWw2tL7fu3Wi_gaLJoQm4LnvR3EQfPN-z9TY7sqyVojnvPfqOtrgPpHbUoytSLKkl6UtPzp9ebFaWHV_yo1mQCGHCBP-HdqwMabsvj20MTYKRNT4lPg7tiAbBDIXZu1-5X9NDqCdLgeQm8MYhYYosLcYtzbW34EFQ Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:15:29.070365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b672d5801cb4fdf87d6626f4603e281", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c7c57f5e11a84bf98d474837adbb0ba7 Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {"volumeAttachment": {"volumeId": "7ae3c401-5351-4226-b74d-d67c5559418e"}} Aug 05 05:15:29.071551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Cannot 'attach_volume' instance aff6e938-a58e-4bba-8294-f82b51bc8780 while it is in vm_state rescued Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'server_id': 'aff6e938-a58e-4bba-8294-f82b51bc8780', 'body': {'volumeAttachment': {'volumeId': '7ae3c401-5351-4226-b74d-d67c5559418e'}}} Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:15:29.076028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aff6e938-a58e-4bba-8294-f82b51bc8780 while it is in vm_state rescued Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:15:29.077956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aff6e938-a58e-4bba-8294-f82b51bc8780 while it is in vm_state rescued Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Returning 409 to user: Cannot 'attach_volume' instance aff6e938-a58e-4bba-8294-f82b51bc8780 while it is in vm_state rescued {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b4ac9941-104c-4c05-8606-4fbda97e74aa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.093649 Aug 05 05:15:29.079480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 129/264] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:15:28 2022] POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/os-volume_attachments => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 05 05:15:29.086529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:29.088246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:29.099628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:29.103924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:29.104435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:29.105169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:29.105706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:29.108235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:29.238389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-49181e5d-3194-4224-82d9-a84471aa78bd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/action" status: 202 len: 0 microversion: 2.1 time: 0.156556 Aug 05 05:15:29.242860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 136/265] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:15:29 2022] POST /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:15:29.251577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:29.252920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:29.268667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:29.271340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:29.271992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:29.272806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:29.273261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:29.273699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:29.567983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:29.576780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9ae1b8e5-00f3-401b-9e1b-84b3c5ffcbf6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1508 microversion: 2.1 time: 0.329503 Aug 05 05:15:29.578229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 130/266] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:29 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:30.600971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:30.601668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:30.614369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:30.614869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:30.615303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:30.616037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:30.616502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:30.617077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:30.785264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:30.794615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a9c3469a-df8f-4a70-bac5-40f7a5757d9a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1508 microversion: 2.1 time: 0.199375 Aug 05 05:15:30.795430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 137/267] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:30 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:31.816510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:31.817135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:31.824247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:31.824892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:31.825367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:31.826308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:31.827082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:31.827548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:31.831480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:32.127340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:32.142295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dd386a51-9cce-42d6-a808-e6534d497827 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1508 microversion: 2.1 time: 0.330001 Aug 05 05:15:32.143295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 131/268] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:31 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:32.294891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:32.295489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:32.301918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:32.302411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:32.302837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:32.303675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:32.303981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:32.304394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:32.327439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-af1d9e12-917c-41e9-92f1-673ea30d8524 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/ips" status: 200 len: 152 microversion: 2.20 time: 0.036487 Aug 05 05:15:32.328083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 138/269] 10.222.0.30 () {60 vars in 1289 bytes} [Fri Aug 5 05:15:32 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:15:33.163806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:33.164807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:33.171265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:33.171740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:33.172207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:33.172889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:33.173334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:33.173753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:33.368808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:33.381440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f4a00606-1b0f-4975-81e8-18470a9fa8ec tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1514 microversion: 2.1 time: 0.220577 Aug 05 05:15:33.382039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 132/270] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:33 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:34.471719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b165bb7d-70bd-46d9-af74-4ef64634831f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:34.474255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:34.480696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b165bb7d-70bd-46d9-af74-4ef64634831f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:34.481216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b165bb7d-70bd-46d9-af74-4ef64634831f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:34.481684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b165bb7d-70bd-46d9-af74-4ef64634831f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:34.548336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b165bb7d-70bd-46d9-af74-4ef64634831f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Going to try to stop instance {{(pid=117903) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 05:15:34.595213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b165bb7d-70bd-46d9-af74-4ef64634831f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action" status: 202 len: 0 microversion: 2.1 time: 0.127194 Aug 05 05:15:34.595931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 139/271] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:15:34 2022] POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:15:34.604458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:34.610429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:34.620082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:34.620544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:34.621137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:34.622147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:34.622775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:34.623932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:34.769811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:34.779173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-63c897dd-7a23-41c9-b4f9-b53b4a58c7a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.178577 Aug 05 05:15:34.779753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 133/272] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:34 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:34.832688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f20c708e-51a9-4447-aecc-f89414da8ecd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'create', calling method: .version_select at 0x7fdc9dd51670>, body: {"keypair": {"name": "tempest-keypair-1300815495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWkqexmZnPDGeKVzYn7H1SqaheZQc4IVJLCwkC0iUXrLrekWhDDpxEOQeOwHdQrWuDxCyQXaz/87vDv4igEqTW5Z1Nb8CgFXfISULqu3JhZefG0O4h+e8569Untm3Bhtg=="}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:34.848502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-f20c708e-51a9-4447-aecc-f89414da8ecd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:15:34.852348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-f20c708e-51a9-4447-aecc-f89414da8ecd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for user c7c57f5e11a84bf98d474837adbb0ba7 and project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:15:34.875897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f20c708e-51a9-4447-aecc-f89414da8ecd tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048776 Aug 05 05:15:34.876557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 140/273] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:15:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:35.801304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:35.801924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:35.808677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:35.809170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:35.809590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:35.810348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:35.810790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:35.811185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:35.972703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:35.982519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8edfc193-8138-462a-bbd1-1fa965d56148 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.184963 Aug 05 05:15:35.989587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 134/274] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:35 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:36.203488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:36.204221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:36.211464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:36.211994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:36.212687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:36.213614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:36.214070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:36.214496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:36.236553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1490276603", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e849852-6742-4bcf-aa40-3ba3f2f184cd"}], "security_groups": [{"name": "tempest-securitygroup--2085273054"}], "key_name": "tempest-keypair-1300815495", "user_data": "}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:36.239330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lazy-loading 'flavor' on Instance uuid 5edf8301-151e-4713-83c9-fe12e7517fe0 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:15:36.386587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] validate_networks() for [('3e849852-6742-4bcf-aa40-3ba3f2f184cd', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:15:36.475823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-73e4a70d-8845-4507-ac12-f9865a7aa6b8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/action" status: 202 len: 0 microversion: 2.20 time: 0.276942 Aug 05 05:15:36.476862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 141/275] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Aug 5 05:15:36 2022] POST /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:15:36.487245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:36.488576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:36.495700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:36.496243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:36.496677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:36.497507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:36.497957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:36.498568 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:36.782205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:36.792908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:36.794909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:36.796329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b1e7798b-9129-4c04-a4ac-da57fa1b380e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.314950 Aug 05 05:15:36.796981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 142/276] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:36 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:15:37.009957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:37.010879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:37.017623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:37.018542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:37.019117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:37.020229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:37.020866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:37.021534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:37.108541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:15:37.109043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:15:37.109988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:15:37.110505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:15:37.111019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:15:37.138908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:37.142058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:37.143722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:37.144786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:37.147366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:37.148708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:37.187061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:15:37.192046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Getting quotas for user c7c57f5e11a84bf98d474837adbb0ba7 and project 4b672d5801cb4fdf87d6626f4603e281. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:15:37.203890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:15:37.206287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:15:37.238632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:37.248020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0c9adf20-a099-4b33-a7c5-11278fe87d04 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.241805 Aug 05 05:15:37.248894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 143/277] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:37 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:37.280813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6f9ae6be-2c6a-42ff-8417-e7ac985a6b82 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.049129 Aug 05 05:15:37.282013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 135/278] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:15:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 05:15:37.293473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b5508f2a-87bd-4971-9309-7a053a98a762 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:37.294094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b5508f2a-87bd-4971-9309-7a053a98a762 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:37.354653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b5508f2a-87bd-4971-9309-7a053a98a762 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:37.362609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b5508f2a-87bd-4971-9309-7a053a98a762 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1246 microversion: 2.1 time: 0.073599 Aug 05 05:15:37.374685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 144/279] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:37 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:37.820051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:37.820713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:37.827612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:37.828161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:37.828667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:37.829365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:37.829924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:37.830330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:37.965680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:37.974289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:37.975821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:37.977489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fa57b667-b05f-4abc-86b8-6909ad83a51d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.162166 Aug 05 05:15:37.978085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 136/280] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:37 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:38.273230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:38.273769 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:38.282313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:38.282812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:38.283260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:38.284023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:38.284476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:38.284906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:38.384672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:38.385312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:38.391797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:38.392297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:38.392906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:38.393622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:38.394068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:38.394565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:38.429539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:38.438151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-56652e64-ae1a-4e52-91e5-bc1094341f13 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.170646 Aug 05 05:15:38.438957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 145/281] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:38 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:38.456778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:38.464335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-25f6745c-a0b0-478c-9ea9-6f006d28d302 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1298 microversion: 2.1 time: 0.083717 Aug 05 05:15:38.464861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 137/282] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:38 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:39.002569 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:39.002742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:39.009097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:39.009582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:39.010021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:39.010793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:39.011253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:39.011672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:39.194114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:39.202282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:39.203832 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:39.204998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-11c75276-e3a5-4376-a50b-ccc157d17b41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.207842 Aug 05 05:15:39.205564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 146/283] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:38 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:39.458688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:39.459318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:39.466068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:39.466598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:39.467026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:39.467714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:39.468171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:39.468584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:39.489485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:39.490227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:39.496834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:39.497451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:39.497975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:39.498871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:39.499384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:39.500012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:39.503005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:39.767063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:39.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-08febc17-96e4-43ad-8d01-9bedf132f571 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.321763 Aug 05 05:15:39.777440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 138/284] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:39 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:39.795410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:39.803683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-81034495-9600-4ad2-86ec-cd9e014ca7d5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.318485 Aug 05 05:15:39.804298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 147/285] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:39 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:40.228701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:40.229315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:40.236007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.236495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.236927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:40.237623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.238073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.238495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:40.439317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:40.447798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:40.449275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:40.450689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-27acb850-1886-4bc5-ac5b-28eb599403b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.226134 Aug 05 05:15:40.451244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 139/286] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:40 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:40.678996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-d99e339c-fb3c-41f5-8ad3-35c077b3e36b req-9c9500b2-47d5-4349-b68f-428d86460eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed093e9-77c9-43a3-b480-77d26728cb34", "tag": "232fe0eb-f94f-4739-bf4b-435ded0bfd05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:40.690673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d99e339c-fb3c-41f5-8ad3-35c077b3e36b req-9c9500b2-47d5-4349-b68f-428d86460eb6 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.691421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d99e339c-fb3c-41f5-8ad3-35c077b3e36b req-9c9500b2-47d5-4349-b68f-428d86460eb6 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.692016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d99e339c-fb3c-41f5-8ad3-35c077b3e36b req-9c9500b2-47d5-4349-b68f-428d86460eb6 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:40.706775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-d99e339c-fb3c-41f5-8ad3-35c077b3e36b req-9c9500b2-47d5-4349-b68f-428d86460eb6 service nova] Creating event network-changed:232fe0eb-f94f-4739-bf4b-435ded0bfd05 for instance bed093e9-77c9-43a3-b480-77d26728cb34 on hv-cinder-81558 Aug 05 05:15:40.712449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-d99e339c-fb3c-41f5-8ad3-35c077b3e36b req-9c9500b2-47d5-4349-b68f-428d86460eb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037851 Aug 05 05:15:40.713245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 148/287] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:40.799359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:40.800968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:40.808452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.809129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.809535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:40.810241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.810748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.811325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:40.825173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:40.825941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:40.833187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.833853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.834486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:40.835152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:40.835606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:40.838916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:41.105155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:41.110743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:41.113862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5bd3807a-c671-4648-913c-35956fb5fa8e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.318952 Aug 05 05:15:41.114446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 140/288] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:40 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:41.119715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d6e8ee2e-9dae-4d54-84b0-871468f4ebb1 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.298707 Aug 05 05:15:41.120634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 149/289] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:40 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:41.474981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:41.475607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:41.482434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:41.483002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:41.483544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:41.484416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:41.484918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:41.485336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:41.619118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:41.628573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:41.630082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:41.631296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8527be34-0969-4d24-8f17-8ee96fec392e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.160299 Aug 05 05:15:41.631912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 141/290] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:41 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:42.135633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:42.136274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:42.142192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:42.142800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:42.143352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:42.143920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:42.144323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:42.145267 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:42.145911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:42.146211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:42.149470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:42.149941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:42.150379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:42.151075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:42.151512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:42.151949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:42.347141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:42.354269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:42.355534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-58087749-a24a-463b-a395-0261d3220329 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.223855 Aug 05 05:15:42.356277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 150/291] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:42 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:42.362397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-98aa82b9-710c-4f40-a16e-50d69ff6be77 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.224675 Aug 05 05:15:42.362965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 142/292] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:42 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:42.654829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:42.655438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:42.662213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:42.662709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:42.663140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:42.664234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:42.664689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:42.665101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:42.891886 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:42.900143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:42.902423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:42.904072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5b16f195-b917-4eed-be2a-c7e437b04c92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.253165 Aug 05 05:15:42.904706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 151/293] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:42 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:43.380835 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:43.381641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:43.384095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:43.384832 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:43.388592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:43.389170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:43.389601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:43.390294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:43.390719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:43.391132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:43.392255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:43.392754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:43.393186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:43.393873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:43.394321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:43.394744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:43.586471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:43.589089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:43.594900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-279af1c1-5afe-4411-ad7b-d95cad0ed9ba tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.219101 Aug 05 05:15:43.595520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 143/294] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:43 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:43.596877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-03a859b1-ba74-4f2a-969e-f10f47a98df4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.217151 Aug 05 05:15:43.597442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 152/295] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:43 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:43.928581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:43.929194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:43.935625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:43.936138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:43.936568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:43.937254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:43.937698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:43.938117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:44.074399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:44.082821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:44.084339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:44.085501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f466d335-6679-4f12-abb2-a61e4a7f2c70 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.161568 Aug 05 05:15:44.086061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 144/296] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:43 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:44.618875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:44.619815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:44.620702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:44.621574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:44.629449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:44.630149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:44.630762 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:44.630969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:44.631601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:44.631921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:44.632300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:44.632605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:44.633194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:44.633388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:44.633896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:44.634493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:44.834052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:44.837315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:44.842158 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b3443a38-bcb0-4732-9b4d-23a871bc9373 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.229054 Aug 05 05:15:44.842822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 153/297] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:44 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:44.845231 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5aafd133-39e3-4eb9-a411-5d208baa3bf5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.229953 Aug 05 05:15:44.845802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 145/298] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:44 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:45.113344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:45.114324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:45.124488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:45.125276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:45.125989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:45.127100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:45.127887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:45.128302 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:45.259440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:45.268381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:45.269869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:45.271022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-00d48a68-0a50-4f13-a6f0-0d92a3b71101 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.164478 Aug 05 05:15:45.271550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 154/299] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:45 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:45.864697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:45.865321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:45.866334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:45.867105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:45.871922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:45.872452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:45.872888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:45.873623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:45.873892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:45.874076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:45.874401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:45.874522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:45.874861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:45.875588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:45.876095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:45.876539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:46.066412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:46.073628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:46.074935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c0191d9a-8fcf-4825-916e-b07fe9c8f81f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.214427 Aug 05 05:15:46.075482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 146/300] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:45 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:46.081253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b7591ddf-c7b4-4901-9461-71fbc11c768b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.219098 Aug 05 05:15:46.081784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 155/301] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:45 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:46.299197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:46.299941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:46.306529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:46.307007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:46.307429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:46.308233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:46.308702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:46.309117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:46.443274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:46.451745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:46.453941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:46.455116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ba252140-0b16-471b-bd8d-cca43d95c4a1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.163792 Aug 05 05:15:46.455891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 147/302] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:46 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:46.465730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-e54ed967-2cf1-4efc-9a01-5767b404bd7e req-b19bc420-456d-4f86-8e0d-82edf0ea2c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed093e9-77c9-43a3-b480-77d26728cb34", "name": "network-vif-plugged", "status": "completed", "tag": "232fe0eb-f94f-4739-bf4b-435ded0bfd05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:46.476002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-e54ed967-2cf1-4efc-9a01-5767b404bd7e req-b19bc420-456d-4f86-8e0d-82edf0ea2c47 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:46.476690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-e54ed967-2cf1-4efc-9a01-5767b404bd7e req-b19bc420-456d-4f86-8e0d-82edf0ea2c47 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:46.477168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-e54ed967-2cf1-4efc-9a01-5767b404bd7e req-b19bc420-456d-4f86-8e0d-82edf0ea2c47 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:46.489388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-e54ed967-2cf1-4efc-9a01-5767b404bd7e req-b19bc420-456d-4f86-8e0d-82edf0ea2c47 service nova] Creating event network-vif-plugged:232fe0eb-f94f-4739-bf4b-435ded0bfd05 for instance bed093e9-77c9-43a3-b480-77d26728cb34 on hv-cinder-81558 Aug 05 05:15:46.494627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-e54ed967-2cf1-4efc-9a01-5767b404bd7e req-b19bc420-456d-4f86-8e0d-82edf0ea2c47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032554 Aug 05 05:15:46.495303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 156/303] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:47.096518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:47.097021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:47.102086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:47.102776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:47.103894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:47.104372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:47.104798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:47.105457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:47.105932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:47.106338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:47.109285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:47.109765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:47.110195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:47.110879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:47.111326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:47.111755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:47.121562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:47.175084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:47.199066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:47.298493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:47.301485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:47.307343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ad9c13cc-a109-4a21-895e-089b7dc65996 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.214799 Aug 05 05:15:47.308529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 148/304] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:47 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:47.315592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d75f9367-d858-41cb-962c-f3d1d52cfbaa tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.218083 Aug 05 05:15:47.316219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 157/305] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:47 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:47.482653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:47.482855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:47.490734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:47.491216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:47.491634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:47.492346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:47.492790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:47.493202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:47.624896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:47.637012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:47.639397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:47.641286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b0e09416-826c-4149-a122-7a325f3c0a43 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.165776 Aug 05 05:15:47.642126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 149/306] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:47 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:48.333720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:48.334284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:48.336275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:48.337759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:48.338595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:48.341120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:48.342775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:48.343316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:48.343784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:48.344488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:48.344938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:48.345360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:48.346950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:48.347435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:48.347905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:48.348625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:48.349061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:48.349499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:48.536793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:48.539732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:48.546800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-665e9354-7e51-4954-867b-b8fb3780477d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.219447 Aug 05 05:15:48.547617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 158/307] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:48 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:48.548986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-65a703f5-1586-4a4e-a926-312b6b2e4be8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1372 microversion: 2.1 time: 0.215570 Aug 05 05:15:48.549707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 150/308] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:48 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:48.666102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:48.666852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:48.672819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:48.673285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:48.673708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:48.674376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:48.674813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:48.675218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:48.808785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:48.817240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:48.818717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:48.819903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d2025a2a-0cef-466a-a1d8-dc1c35f7d80e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.158080 Aug 05 05:15:48.820432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 159/309] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:48 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:49.567744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:49.568361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:49.570375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:49.571032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:49.575370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.575888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.576302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.576991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.577437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.577848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.577961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.578357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.578786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.579472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.580031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.580450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.769752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:49.773238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:49.778097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-87ab31e2-c035-41a8-9474-eb0eddf1ef31 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.214335 Aug 05 05:15:49.778685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 151/310] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:49 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:49.780857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eb5f894b-c51c-44f2-af43-196f2e0d191b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1566 microversion: 2.1 time: 0.214296 Aug 05 05:15:49.781419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 160/311] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:49 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:49.801674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:49.802190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:49.808359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.808846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.809263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.810225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.810696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.811121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.843752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:49.844470 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:49.850741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.851461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.852082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.852777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:49.853272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:49.853723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:49.892653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5b1f070d-7033-4aa3-bdca-5f25f285349b tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094886 Aug 05 05:15:49.893245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 152/312] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:15:49 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:15:49.993273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:50.002389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:50.004319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:50.005753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e4138a19-9cfd-4b2e-8c33-b62e7dba8690 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.166053 Aug 05 05:15:50.006314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 161/313] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:49 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:50.800765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:50.801309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:50.807210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:50.807794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:50.808237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:50.809102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:50.809551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:50.809971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:50.962447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:50.970717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2bcac789-c098-429a-84d6-9d0c2814dc3a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.174574 Aug 05 05:15:50.971914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 153/314] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:50 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:51.029863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:51.030476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:51.037023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:51.037871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:51.038309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:51.039366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:51.039837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:51.040318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:51.082251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-b69bcff1-67a8-4e42-97ea-80efcdfdb00f req-97f95eec-a0d5-4cac-b6c3-967e3431372b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed093e9-77c9-43a3-b480-77d26728cb34", "tag": "232fe0eb-f94f-4739-bf4b-435ded0bfd05"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:51.094562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-b69bcff1-67a8-4e42-97ea-80efcdfdb00f req-97f95eec-a0d5-4cac-b6c3-967e3431372b service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:51.095034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-b69bcff1-67a8-4e42-97ea-80efcdfdb00f req-97f95eec-a0d5-4cac-b6c3-967e3431372b service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:51.095823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-b69bcff1-67a8-4e42-97ea-80efcdfdb00f req-97f95eec-a0d5-4cac-b6c3-967e3431372b service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:51.108297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-b69bcff1-67a8-4e42-97ea-80efcdfdb00f req-97f95eec-a0d5-4cac-b6c3-967e3431372b service nova] Creating event network-changed:232fe0eb-f94f-4739-bf4b-435ded0bfd05 for instance bed093e9-77c9-43a3-b480-77d26728cb34 on hv-cinder-81558 Aug 05 05:15:51.114121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-b69bcff1-67a8-4e42-97ea-80efcdfdb00f req-97f95eec-a0d5-4cac-b6c3-967e3431372b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038832 Aug 05 05:15:51.115211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 154/315] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:15:51.342684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:51.352434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:51.354217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:51.355381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0b7fa73a-12f1-4ec8-87a7-7f280f9a1439 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.329530 Aug 05 05:15:51.355951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 162/316] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:51 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:52.001982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:52.002450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:52.021167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:52.021981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:52.022574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:52.023459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:52.024158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:52.025415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:52.168875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:52.177241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c3dec9a5-5f0d-49ac-82af-90ad35d59d1c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.188417 Aug 05 05:15:52.177985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 155/317] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:51 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:52.381540 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:52.382677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:52.389275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:52.389745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:52.390178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:52.390868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:52.391316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:52.391758 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:52.533175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:52.541709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:52.543309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:52.544562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c770146b-55ce-4395-9a5e-0775d0c19e72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.170023 Aug 05 05:15:52.550355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 163/318] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:52 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:53.198313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:53.198811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:53.205345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:53.205829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:53.206255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:53.206978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:53.207417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:53.207849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:53.342422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:53.350745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-80f2bb45-e680-4805-8964-4416746d10ac tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.156376 Aug 05 05:15:53.351324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 156/319] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:53 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:53.567114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:53.567748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:53.574648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:53.575129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:53.575558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:53.576327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:53.576772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:53.577189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:53.710501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:53.718863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:53.720400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:53.721618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-401b41a9-6500-4f0c-93b6-585c349da069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.158570 Aug 05 05:15:53.722114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 164/320] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:53 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:54.372211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:54.372819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:54.379722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:54.380311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:54.380740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:54.381431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:54.381883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:54.382303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:54.512490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:54.520684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f162a96d-21e1-481f-96c8-3b079c29bbe4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1723 microversion: 2.1 time: 0.152505 Aug 05 05:15:54.521215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 157/321] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:54 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:54.745021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:54.745710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:54.752517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:54.753000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:54.753428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:54.754268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:54.754690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:54.755131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:54.758070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:15:54.889057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:54.897108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:54.898596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:54.899748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-42138e29-9230-4b5a-82b4-0224e9ff9dd0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.158669 Aug 05 05:15:54.900309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 165/322] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:54 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:55.542391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:55.543008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:55.549865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.550345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.550778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:55.551490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.551987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.552392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:55.696274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:55.704425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e083f60b-42e4-4920-bef1-acb5bac33333 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1700 microversion: 2.1 time: 0.166351 Aug 05 05:15:55.704989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 158/323] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:55 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:55.724870 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6f9d0612-5c15-464d-8efe-59931f4fc7f3 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:15:55.731161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6f9d0612-5c15-464d-8efe-59931f4fc7f3 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.731648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6f9d0612-5c15-464d-8efe-59931f4fc7f3 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.732112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6f9d0612-5c15-464d-8efe-59931f4fc7f3 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:55.754404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6f9d0612-5c15-464d-8efe-59931f4fc7f3 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Going to try to start instance {{(pid=117903) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 05:15:55.799344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6f9d0612-5c15-464d-8efe-59931f4fc7f3 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action" status: 202 len: 0 microversion: 2.1 time: 0.078204 Aug 05 05:15:55.800132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 166/324] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:15:55 2022] POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:15:55.808363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:55.808972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:55.815184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.815862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.816321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:55.817070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.817531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.818006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:55.924278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:55.924977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:55.932047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.932538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.933350 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:55.934099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:55.934549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:55.934977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:56.323638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:56.333195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b5fede08-807b-44ba-a392-e95fbde32520 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1709 microversion: 2.1 time: 0.528543 Aug 05 05:15:56.333799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 159/325] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:55 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1709 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:15:56.352681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:56.360931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:56.363134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:56.364393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-378ff2ec-85cd-443c-8682-bd11c5091c76 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.444993 Aug 05 05:15:56.364957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 167/326] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:55 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:57.354468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:57.355083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:57.361591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:57.362064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:57.362488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:57.363161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:57.363608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:57.364056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:57.387262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:57.388090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:57.394992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:57.395474 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:57.395934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:57.396610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:57.397048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:57.397549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:57.561332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:57.566279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:57.569677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-30ba5525-18d0-4b54-9cff-0fa4f133c4c1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1709 microversion: 2.1 time: 0.219138 Aug 05 05:15:57.570374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 160/327] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:57 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:57.575345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:57.577006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:57.578266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-25365cf2-c003-4377-b9ce-3b6cd29ed36d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1744 microversion: 2.20 time: 0.195003 Aug 05 05:15:57.583855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 168/328] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:57 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:15:58.591459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:58.592081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:58.599002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:58.599489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:58.600005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:58.600714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:58.601160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:58.601732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:58.602039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:58.602793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:58.609989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:58.610498 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:58.611017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:58.611699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:58.612193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:58.612622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:58.799787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:58.806437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:58.807861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b31f0e6a-78a5-4c0a-893f-5733c92ff46c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1713 microversion: 2.1 time: 0.220492 Aug 05 05:15:58.808429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 161/329] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:15:58 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1713 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:15:58.814822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:58.816334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:15:58.817656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-168b29d8-18b6-41af-8ab4-b5944cdbb7be tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1744 microversion: 2.20 time: 0.219777 Aug 05 05:15:58.818513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 169/330] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:58 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:15:59.840521 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:15:59.841196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:15:59.848059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:59.848553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:59.848985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:15:59.849802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:15:59.850249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:15:59.850663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:00.048019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:00.056637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:00.058138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:00.059343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bbb7a71d-6493-4dd9-817d-4085bec6bd92 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1744 microversion: 2.20 time: 0.222953 Aug 05 05:16:00.059893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 162/331] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:15:59 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:01.084145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:01.084967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:01.091944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:01.092426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:01.092849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:01.093731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:01.094171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:01.094740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:01.263927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:01.274643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:01.276462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:01.277916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9d100406-8976-40c8-94a9-c0c2260a5cbd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.198323 Aug 05 05:16:01.299751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 170/332] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:01 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:02.323189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:02.324146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:02.333737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:02.334504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:02.335084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:02.335963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:02.336609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:02.337430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:02.528127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:02.551194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:02.554386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:02.565672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e4b5a7b8-421b-46e2-b6cf-2dee2d701436 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.262856 Aug 05 05:16:02.566430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 163/333] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:02 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:02.641474 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-f90c92a5-c04f-4d7e-bbd1-e29243e8ac87 req-d5129074-b5dc-4506-8528-347d63544a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "name": "network-vif-plugged", "status": "completed", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:02.662604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f90c92a5-c04f-4d7e-bbd1-e29243e8ac87 req-d5129074-b5dc-4506-8528-347d63544a1f service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:02.663245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f90c92a5-c04f-4d7e-bbd1-e29243e8ac87 req-d5129074-b5dc-4506-8528-347d63544a1f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:02.664124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f90c92a5-c04f-4d7e-bbd1-e29243e8ac87 req-d5129074-b5dc-4506-8528-347d63544a1f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:02.676852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-f90c92a5-c04f-4d7e-bbd1-e29243e8ac87 req-d5129074-b5dc-4506-8528-347d63544a1f service nova] Creating event network-vif-plugged:fce17f2c-7a6f-4061-9c80-3211fcf7ac05 for instance 5edf8301-151e-4713-83c9-fe12e7517fe0 on hv-cinder-81558 Aug 05 05:16:02.683149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-f90c92a5-c04f-4d7e-bbd1-e29243e8ac87 req-d5129074-b5dc-4506-8528-347d63544a1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046771 Aug 05 05:16:02.684688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 171/334] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:16:03.590705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:03.591477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:03.603492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:03.606502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:03.607220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:03.608258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:03.608929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:03.609639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:03.921711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:03.936936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:03.939276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:03.940954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b9ee5623-2649-4c2a-840d-797c05df38bc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.354877 Aug 05 05:16:03.941684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 164/335] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:03 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:04.977567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:04.979864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:04.982372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:04.993521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:04.994457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:04.995044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:04.998415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:04.999162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:04.999748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:05.250548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:05.262103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:05.265882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:05.267673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9c285949-5952-4766-964c-c71b273da4ec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.306166 Aug 05 05:16:05.292127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 172/336] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:04 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:06.292182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:06.293619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:06.302585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:06.308263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:06.309467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:06.311108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:06.312787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:06.313414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:06.526891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:06.539451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:06.541284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:06.542680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5ba062f9-233c-4b16-917f-2c2e49e3cda1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.256084 Aug 05 05:16:06.546041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 165/337] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:06 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:07.574347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:07.575720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:07.587509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:07.589294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:07.592210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:07.595295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:07.596361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:07.597740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:07.857831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:07.871815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:07.873340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:07.874526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-92ce8000-3493-43a8-ac7a-1951f8217d11 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.309395 Aug 05 05:16:07.888956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 173/338] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:07 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:08.899413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:08.900194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:08.907147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:08.907912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:08.908519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:08.909391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:08.910011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:08.910426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:08.914275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:09.102491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:09.113601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:09.116025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:09.118145 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-492468de-e808-498a-83a9-ee8586b8acd1 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.223268 Aug 05 05:16:09.119299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 166/339] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:08 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:10.142481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:10.143709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:10.155557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:10.156287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:10.156890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:10.157777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:10.158382 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:10.162262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:10.497793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:10.513801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:10.515330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:10.516538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8e2fbf28-3d27-4352-b8ef-48e9338214cc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.378159 Aug 05 05:16:10.532958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 174/340] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:10 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:11.543677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:11.547285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:11.572203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:11.573006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:11.573619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:11.575253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:11.577883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:11.579027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:11.853043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:11.861730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:11.869756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:11.874181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e16ccae1-8f3f-4585-bd01-db1a45b2cc7e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.336909 Aug 05 05:16:11.876069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 167/341] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:11 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:12.899516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:12.900603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:12.908408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:12.909546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:12.909772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:12.910684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:12.911418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:12.912059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:13.131746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:13.170307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:13.172675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:13.174211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cb4a20f3-ec4f-435d-8161-ddb1ec87ed81 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1739 microversion: 2.20 time: 0.280233 Aug 05 05:16:13.175706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 175/342] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:12 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:14.206401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:14.207701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:14.220119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:14.220611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:14.223759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:14.224553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:14.225013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:14.225725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:14.407335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:14.418972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:14.420515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:14.421707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e1a2e1d7-43a7-4d7f-9f86-ccb85d7695c3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1721 microversion: 2.20 time: 0.226728 Aug 05 05:16:14.435790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 168/343] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:14 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:15.446940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:15.448178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:15.456426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:15.457133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:15.457702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:15.458570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:15.459009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:15.459427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:15.609801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:15.618300 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:15.619877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:15.621415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-11caf0c8-68e7-4030-b35d-4ec64cac2fc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1721 microversion: 2.20 time: 0.178714 Aug 05 05:16:15.621980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 176/344] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:15 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:16.646662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:16.647945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:16.661030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:16.662492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:16.664778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:16.666624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:16.667240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:16.668334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:16.848073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:16.867293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:16.869928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:16.871505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d834d4f1-d415-413b-8284-dfce1f2dda9a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1721 microversion: 2.20 time: 0.229506 Aug 05 05:16:16.883527 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 169/345] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:16 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:17.897381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:17.898022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:17.904476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:17.904960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:17.905377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:17.906067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:17.906513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:17.906934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.071750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:18.082162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:18.083927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:18.085508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-815fb48a-de7f-4294-b1d5-72b6c3d87e3c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1664 microversion: 2.20 time: 0.194293 Aug 05 05:16:18.086619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 177/346] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:17 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1664 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:18.110742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f13f815a-1482-46fc-8161-8ac9385d331a"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:18.113250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:18.124503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.126913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.130421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.131382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.132148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.132764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.598044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-251db8cc-5977-41c4-b2e2-e8521f022833 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.491207 Aug 05 05:16:18.598746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 170/347] 10.222.0.30 () {62 vars in 1364 bytes} [Fri Aug 5 05:16:18 2022] POST /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments => generated 188 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:16:18.663996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-d4e690b6-a772-40fd-8743-45a713cce75c req-8eb1cb3c-36d8-4590-acf6-4f9e9dd3fae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "name": "network-vif-unplugged", "status": "completed", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:18.690309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d4e690b6-a772-40fd-8743-45a713cce75c req-8eb1cb3c-36d8-4590-acf6-4f9e9dd3fae1 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.691062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d4e690b6-a772-40fd-8743-45a713cce75c req-8eb1cb3c-36d8-4590-acf6-4f9e9dd3fae1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.691631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d4e690b6-a772-40fd-8743-45a713cce75c req-8eb1cb3c-36d8-4590-acf6-4f9e9dd3fae1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.708303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.compute.server_external_events [req-d4e690b6-a772-40fd-8743-45a713cce75c req-8eb1cb3c-36d8-4590-acf6-4f9e9dd3fae1 service nova] Unable to find a host for instance 5edf8301-151e-4713-83c9-fe12e7517fe0. Dropping event network-vif-unplugged {{(pid=117903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 05:16:18.709818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-d4e690b6-a772-40fd-8743-45a713cce75c req-8eb1cb3c-36d8-4590-acf6-4f9e9dd3fae1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050033 Aug 05 05:16:18.710799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 178/348] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 05:16:18.792507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:18.793546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:18.799727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=42 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:18.804839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.805612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.806227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.806950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.807397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.808041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.867384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117902) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 05:16:18.966210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b9a6dfe7-34b7-4be5-9d0c-ac88197de022 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/action" status: 202 len: 0 microversion: 2.20 time: 0.178909 Aug 05 05:16:18.967180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 171/349] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Aug 5 05:16:18 2022] POST /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:16:18.975149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:18.976422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:18.983144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.984002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.985024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:18.985887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:18.986421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:18.986931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:19.166547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:19.177768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:19.179628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:19.181173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c4688e05-8e44-4cb2-8038-aad904f45d72 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1750 microversion: 2.20 time: 0.209983 Aug 05 05:16:19.201690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 179/350] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:18 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1750 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:20.209436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:20.210106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:20.234532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:20.235025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:20.235461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:20.236222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:20.236983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:20.239711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:20.466061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:20.474779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:20.476390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:20.478479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c9aed32a-03fd-4dc9-bddd-2453938629b6 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1752 microversion: 2.20 time: 0.273989 Aug 05 05:16:20.479438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 172/351] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:20 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1752 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:21.501985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:21.502636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:21.510340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:21.510952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:21.511460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:21.512211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:21.512810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:21.513414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:21.664146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:21.678459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:21.679996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:21.681529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-424225c9-235d-4551-8745-9f5b25fec82e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.183529 Aug 05 05:16:21.684875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 180/352] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:21 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:22.706677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:22.707277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:22.715038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:22.715600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:22.716116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:22.716889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:22.718021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:22.718501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:22.889332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:22.898562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:22.900383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:22.901762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d75c3c08-1794-48ee-a7ca-9010a76d5b2a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.199295 Aug 05 05:16:22.903093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 173/353] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:22 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:23.926612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:23.927304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:23.936146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:23.936966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:23.937561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:23.938930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:23.939550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:23.941047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:24.143907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:24.160942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:24.165191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:24.168034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ad386cd3-0851-4249-81b0-4c3875f7d4f7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.244812 Aug 05 05:16:24.169885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 181/354] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:23 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:24.943658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-289832d7-3943-4d6e-8c99-b041569b4b5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Action: 'create', calling method: .version_select at 0x7fdc9dd19ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1901620686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRQF2x0p1PoZwk65co0b/KfC49P/iLdmH1rBZo7BbJL0njORRvZ3+6p4zV2tHFhZ3OYG5IHq7dodZNaqIYjeM0PUHMPuRTUrUxZRE1rf4ve9Ab5HLaa4wvGP5kEB7jZRQ=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:24.960379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-289832d7-3943-4d6e-8c99-b041569b4b5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Getting quotas for project 28b64940359146368434f38f443b5afd. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:16:24.964354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-289832d7-3943-4d6e-8c99-b041569b4b5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Getting quotas for user 65d6d5c6915543dfac67beef1ddaf8b3 and project 28b64940359146368434f38f443b5afd. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:16:24.976339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-289832d7-3943-4d6e-8c99-b041569b4b5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [a1254f64-0acc-43ae-9e2c-69c880b52b5f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:16:25.194187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:25.195007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:25.201710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:25.203367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:25.203959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:25.204775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:25.205327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:25.205839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:25.208854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:25.350407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:25.362698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:25.364235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:25.365400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b5e15c5a-047e-4d1f-b9c1-f4b130049611 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.175330 Aug 05 05:16:25.366140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 182/355] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:25 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:25.984064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [None req-289832d7-3943-4d6e-8c99-b041569b4b5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [a1254f64-0acc-43ae-9e2c-69c880b52b5f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49546. Aug 05 05:16:26.010847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-289832d7-3943-4d6e-8c99-b041569b4b5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.071023 Aug 05 05:16:26.012656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 174/356] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:16:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:16:26.068184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1794898339", "imageRef": "bed2484b-3dea-4ac3-952a-229d92a1db64", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1901620686", "networks": [{"uuid": "fc024871-32b5-43d4-a8ac-7951783ea7ab"}]}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:26.123758 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] validate_networks() for [('fc024871-32b5-43d4-a8ac-7951783ea7ab', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:16:26.388537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:26.389738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:26.398265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:26.398740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:26.399167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:26.399925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:26.400620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:26.401265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:26.569325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:16:26.570451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:16:26.571104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:16:26.571799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:16:26.572306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:16:26.581646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:26.582238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:26.582745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:26.583657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:26.584225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:26.584869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:26.597685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:26.605603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Getting quotas for project 28b64940359146368434f38f443b5afd. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:16:26.606583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:26.608138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:26.609614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a594efd4-8fb3-459e-bfc3-31c695745dc3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.225127 Aug 05 05:16:26.609987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Getting quotas for user 65d6d5c6915543dfac67beef1ddaf8b3 and project 28b64940359146368434f38f443b5afd. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:16:26.621647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:16:26.624263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 175/357] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:26 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:26.630592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bed2484b-3dea-4ac3-952a-229d92a1db64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:16:26.679352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-275bea93-74b0-4a8b-bba3-920174d9f50b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615217 Aug 05 05:16:26.680438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 183/358] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:16:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:16:26.691163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dc0a32d6-c7f2-4a66-badd-afb091fcd276 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:26.692434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dc0a32d6-c7f2-4a66-badd-afb091fcd276 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:26.754708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dc0a32d6-c7f2-4a66-badd-afb091fcd276 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:26.762870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dc0a32d6-c7f2-4a66-badd-afb091fcd276 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1259 microversion: 2.1 time: 0.075754 Aug 05 05:16:26.775559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 176/359] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:26 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:16:27.633904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:27.634620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:27.643632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:27.644170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:27.644880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:27.645825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:27.646491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:27.647355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:27.785651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:27.786373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:27.791006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:27.794224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:27.794928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:27.795494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:27.796396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:27.796990 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:27.797402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:27.801457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:27.803263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:27.804897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-992c4476-9571-4830-8c69-2e7f21d640a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.175745 Aug 05 05:16:27.820463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 184/360] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:27 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:27.872565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:27.880811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-da614c5a-aa65-401b-8fc1-ebb98a9e07a2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1263 microversion: 2.1 time: 0.099015 Aug 05 05:16:27.881721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 177/361] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:27 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1263 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:16:28.829385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:28.830004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:28.837209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:28.837694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:28.838176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:28.838829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:28.839250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:28.843719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:28.905592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:28.906380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:28.914940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:28.916317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:28.917082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:28.917821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:28.918283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:28.918709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:29.006045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:29.009598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:29.015731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-15d7d15a-709c-4159-be97-d0674c506af8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1263 microversion: 2.1 time: 0.115216 Aug 05 05:16:29.016891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 178/362] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:28 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1263 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:16:29.021344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:29.023611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:29.025134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-24a988ac-ad14-4f04-9c36-7e0d1c558b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.199776 Aug 05 05:16:29.032327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 185/363] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:28 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:30.037501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:30.038723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:30.045583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:30.046127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:30.046508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:30.047204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:30.047649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:30.048188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:30.049634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:30.050251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:30.057363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:30.057925 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:30.058539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:30.059307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:30.059937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:30.060410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:30.143499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:30.152760 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cde5dbf4-d2c8-4150-a90a-19b3fa50f1e0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1263 microversion: 2.1 time: 0.119138 Aug 05 05:16:30.153694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 179/364] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:30 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1263 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:30.230479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:30.239236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:30.240762 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:30.241946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-12b2e51a-3761-4fe9-877e-3a13b8b39868 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.196461 Aug 05 05:16:30.242693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 186/365] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:30 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:31.176473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:31.177098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:31.184024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:31.184511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:31.184950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:31.185631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:31.186078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:31.186492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:31.253813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:31.262068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-57656fba-9af9-4cef-80d7-889383e5a752 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1263 microversion: 2.1 time: 0.090452 Aug 05 05:16:31.263334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 180/366] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:31 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:31.266447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:31.267059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:31.274279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:31.274779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:31.275258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:31.276159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:31.276650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:31.277013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:31.629586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:31.638554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:31.640222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:31.641376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-468feef1-77ff-49bd-98a6-b28f569ce795 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.379662 Aug 05 05:16:31.641936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 187/367] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:31 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:32.287098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:32.288517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:32.296540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:32.297020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:32.297453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:32.298147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:32.298593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:32.299012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:32.301564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:32.362017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:32.369980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-82e0b12a-9d35-42ca-ae78-ef7c1a6f63d8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1263 microversion: 2.1 time: 0.089419 Aug 05 05:16:32.370537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 181/368] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:32 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:32.669102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:32.670058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:32.681237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:32.682031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:32.682738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:32.683958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:32.684404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:32.684818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:32.818843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:32.831829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:32.834108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:32.836052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-41174d11-3322-48d7-be11-50cfa9ca0a7c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.173908 Aug 05 05:16:32.836827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 188/369] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:32 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:33.395126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:33.396024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:33.405317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:33.405798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:33.406227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:33.406917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:33.407360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:33.407799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:33.478166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:33.485650 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-35ba16d2-6499-49b5-ba0f-02f691d35330 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1311 microversion: 2.1 time: 0.097322 Aug 05 05:16:33.486218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 182/370] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:33 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:33.860232 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:33.861482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:33.867887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:33.868377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:33.868808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:33.869515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:33.869957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:33.870373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:34.012164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:34.023500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:34.025227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:34.026413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-11a780fe-575f-4b17-a036-de8044f6781a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.170111 Aug 05 05:16:34.027316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 189/371] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:33 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:34.506968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:34.508614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:34.516354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:34.517000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:34.517524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:34.518337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:34.518786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:34.519202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:34.684019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:34.696108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6dfca2b8-1898-46bc-bab2-e38c1d5708bc tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.193167 Aug 05 05:16:34.710007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 183/372] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:34 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:34.710253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a40cce27-919a-4f17-a4ff-01ba747d7b2b"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:34.710253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:34.725035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:34.725530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:34.725962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:34.726666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:34.727113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:34.727539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:35.049993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:35.050603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:35.057096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:35.057592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:35.058037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:35.058807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:35.059466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:35.059915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:35.191400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:35.200504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:35.201995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:35.203232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d67cd4ab-3886-4c54-8908-c786459d21da tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.157629 Aug 05 05:16:35.203850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 184/373] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:35 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:35.719586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:35.720804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:35.727876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:35.728434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:35.728833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:35.729770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:35.730396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:35.730992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:35.874571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:35.883553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fe5869de-9dbb-45ba-8047-54c5ec9b44cb tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.167955 Aug 05 05:16:35.897446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 185/374] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:35 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:36.226847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:36.227467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:36.234089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:36.234576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:36.235045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:36.235741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:36.236218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:36.236632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:36.376440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:36.386049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:36.387643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:36.388866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3072d4a3-1011-4e22-8f27-19b5c3d10986 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.166115 Aug 05 05:16:36.389428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 186/375] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:36 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:36.594753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:36.621505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:36.905200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:36.905819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:36.908465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:36.915208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:36.915685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:36.916242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:36.917100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:36.917676 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:36.918259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:37.056633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:37.065073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e3d8d256-f6e2-425a-ab4e-37ab372494c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.163852 Aug 05 05:16:37.069129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 187/376] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:36 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:37.411600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:37.412248 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:37.419173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:37.419655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:37.420111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:37.420845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:37.421290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:37.421784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:37.575747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:37.584872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:37.586397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:37.587581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-32359ded-4789-438c-bcab-cbaf038ac526 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.180549 Aug 05 05:16:37.588184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 188/377] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:37 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:37.904741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:37.905134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:37.911970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:37.912622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:37.912863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:37.913917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:37.914356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:37.914768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:38.046606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lazy-loading 'services' on Instance uuid 0058bb72-4d0a-4cd2-ace4-549ebc5f018c {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:16:38.169682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4df96264-20dc-4458-b5fb-9d8a213f5570 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-volume_attachments/b5e13868-4708-4a79-b361-555df4226a21" status: 202 len: 0 microversion: 2.1 time: 0.269012 Aug 05 05:16:38.170412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 189/378] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:16:37 2022] DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-volume_attachments/b5e13868-4708-4a79-b361-555df4226a21 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:16:38.176690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:38.177433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:38.184272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:38.184788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:38.185231 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:38.185910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:38.186353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:38.186767 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:38.329975 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:38.338716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2b40c160-a4a3-4223-b144-d94c70dedb4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.166837 Aug 05 05:16:38.349632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 190/379] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:38 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:38.611956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:38.612347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:38.619229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:38.619714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:38.620191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:38.620913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:38.621362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:38.621790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:38.763844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:38.772870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:38.774383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:38.775573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-53463891-8657-4d3b-9a33-3dbf279e0365 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.168255 Aug 05 05:16:38.776150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 191/380] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:38 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:39.359799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:39.360541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:39.367208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:39.367847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:39.368400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:39.369328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:39.369931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:39.370467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:39.508308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:39.517392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-29655bc4-6f4f-4b26-906e-05c15dec21ea tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.161365 Aug 05 05:16:39.518226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 192/381] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:39 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:16:39.798869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:39.799388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:39.806243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:39.806778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:39.807184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:39.808018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:39.808492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:39.808872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:39.948389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:39.957963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:39.959529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:39.960746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-04abfb48-7537-46ea-8fd0-f1c615ac5093 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.166001 Aug 05 05:16:39.961530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 193/382] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:39 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:40.537513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:40.538663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:40.545748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:40.546385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:40.546918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:40.547825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:40.552093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:40.552093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:40.690616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:40.698190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-58800139-105b-4bf8-9ab6-b1889f23abe9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.164621 Aug 05 05:16:40.698760 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 194/383] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:40 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:40.992082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:40.996051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:41.000992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:41.000992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:41.001197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:41.002047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:41.002526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:41.002902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:41.156476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:41.165860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:41.167361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:41.168618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a6b1766b-f8b1-43a9-839e-b85b6dd3f7dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.189724 Aug 05 05:16:41.169381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 195/384] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:40 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:41.720048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:41.720942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:41.728058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:41.728542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:41.729068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:41.729770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:41.730222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:41.730639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:41.876022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:41.884905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7b6f8aaf-11a6-48ec-a594-b64c726105c4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.169107 Aug 05 05:16:41.885495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 196/385] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:41 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:42.190864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:42.191459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:42.198566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:42.199626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:42.200316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:42.201239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:42.202169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:42.202833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:42.220302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:42.347532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:42.356735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:42.358402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:42.359641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-711eed54-7f53-4c6c-b83d-4d1e4c5be6e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.172804 Aug 05 05:16:42.360306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 197/386] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:42 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:42.906195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:42.906877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:42.913971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:42.914454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:42.914889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:42.915571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:42.916053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:42.916496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:43.061491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:43.069312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-846f994f-421c-4ba8-abb0-7d9cc657a1e9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.167198 Aug 05 05:16:43.069877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 198/387] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:42 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:43.382292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:43.382896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:43.389095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:43.389576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:43.390004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:43.390683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:43.391129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:43.391542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:43.525028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:43.534418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:43.535920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:43.537094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-97179866-42f8-4d32-a47b-ef1efc4b5f97 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.158861 Aug 05 05:16:43.537672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 199/388] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:43 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:43.776284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-a1556b87-0013-4458-baa3-e6468566de68 req-18128ba6-253f-4cfa-9e68-fd4d3765401a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:43.785712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-a1556b87-0013-4458-baa3-e6468566de68 req-18128ba6-253f-4cfa-9e68-fd4d3765401a service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:43.786200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-a1556b87-0013-4458-baa3-e6468566de68 req-18128ba6-253f-4cfa-9e68-fd4d3765401a service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:43.786618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-a1556b87-0013-4458-baa3-e6468566de68 req-18128ba6-253f-4cfa-9e68-fd4d3765401a service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:43.797663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-a1556b87-0013-4458-baa3-e6468566de68 req-18128ba6-253f-4cfa-9e68-fd4d3765401a service nova] Creating event network-changed:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:16:43.802754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-a1556b87-0013-4458-baa3-e6468566de68 req-18128ba6-253f-4cfa-9e68-fd4d3765401a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030144 Aug 05 05:16:43.803330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 200/389] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:16:44.091507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:44.092579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:44.098759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:44.099239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:44.099708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:44.100434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:44.100884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:44.101304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:44.177270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-77cce0f1-98e1-4be7-bf12-f08f665477e9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.475318 Aug 05 05:16:44.177902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 190/390] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:16:34 2022] POST /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments => generated 194 bytes in 9477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:16:44.234800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:44.242384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-79aeef55-4ad7-4345-b0c4-1a9c9accd18d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.155833 Aug 05 05:16:44.242940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 201/391] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:44 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:44.562897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:44.562897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:44.574874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:44.582373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:44.582884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:44.583308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:44.584009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:44.584638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:44.585050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:44.725930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:44.735292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:44.736837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:44.738026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1d3318d2-6497-4cb5-b0ad-e8d3096c30c4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.181466 Aug 05 05:16:44.738601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 191/392] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:44 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:45.264732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:45.265409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:45.272263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.272940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.273340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.274211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.274830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.275261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.412365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:45.420709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b88adf9f-18af-4cca-bdc6-a7f4303ff231 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.161947 Aug 05 05:16:45.421283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 202/393] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:45 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:45.698590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e27d03f0-c32d-4766-b088-b954120c197f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:45.705282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e27d03f0-c32d-4766-b088-b954120c197f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.705756 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e27d03f0-c32d-4766-b088-b954120c197f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.706181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e27d03f0-c32d-4766-b088-b954120c197f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.728214 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e27d03f0-c32d-4766-b088-b954120c197f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Going to try to stop instance {{(pid=117903) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 05:16:45.762579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:45.763208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:45.770402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.770896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.771325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.772051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.772505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.773366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.775749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e27d03f0-c32d-4766-b088-b954120c197f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action" status: 202 len: 0 microversion: 2.1 time: 0.080483 Aug 05 05:16:45.776779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 192/394] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:16:45 2022] POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:16:45.786964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:45.788477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:45.795254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.795709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.796168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.796866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:45.797313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:45.797730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:45.977185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:45.984313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:45.986121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:45.987621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:45.988809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3d0c42c0-b24d-4ff2-bb8f-28e4e96a2b69 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.230997 Aug 05 05:16:45.990224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 203/395] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:45 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:45.992089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9eabc9c4-d4e3-410f-b7a8-a9ec67026e9b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.209886 Aug 05 05:16:45.992681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 193/396] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:45 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:16:46.445677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:46.446673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:46.458180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:46.458446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:46.459000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:46.460188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:46.460984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:46.461682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:46.601886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:46.609907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-66b62aed-07cb-400f-a7d9-38e3c9b78e8c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.170668 Aug 05 05:16:46.610469 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 204/397] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:46 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:47.017518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:47.019364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:47.019570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:47.020672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:47.029873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.030063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.030353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.030503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.030782 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.030921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.031474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.031614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.031955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.032115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.032359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.032466 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.244383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:47.250056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:47.255223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:47.257053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:47.258354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ea9e3727-04fb-4511-9675-8117adefa9b3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.247586 Aug 05 05:16:47.259352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 194/398] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:47 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:47.264061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eaa43487-b166-4f38-8569-8e4d6a978be9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.251204 Aug 05 05:16:47.271099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 205/399] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:47 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:47.479660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:47.481998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:47.488099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.488570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.488994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.489663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.490103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.490511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.513152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'flavor' on Instance uuid bed093e9-77c9-43a3-b480-77d26728cb34 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:16:47.609648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:47.631128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:47.631955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:47.639344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.639838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.640465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.641271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.641608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-91093d98-1f63-4485-b596-27e52ece47e2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/action" status: 200 len: 32 microversion: 2.1 time: 0.165799 Aug 05 05:16:47.641795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.642455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.642609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 195/400] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:16:47 2022] POST /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:16:47.651923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:47.652677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:47.660124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.660708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.661148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.661826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:47.662278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:47.662859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:47.846360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:47.851685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:47.854949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-77cbe5de-367c-4e3c-9a1d-43ee9276dd6a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.228138 Aug 05 05:16:47.855529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 206/401] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:47 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:16:47.859997 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a3d9c83b-7d79-4c18-9367-a1f372a36495 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.212096 Aug 05 05:16:47.860866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 196/402] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:47 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:48.283204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:48.283846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:48.285348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:48.285966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:48.291953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.292444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.292973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.293276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.293518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.293675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.293957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.294112 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.294546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.294683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.295081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.295502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.487555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:48.491751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:48.496551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:48.498017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:48.499180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-06d352b2-f8c2-49c7-923b-d4dbe29daed7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.219898 Aug 05 05:16:48.499451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b018b28e-bf46-4cfd-b8d1-26b5cdbd115b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.217964 Aug 05 05:16:48.499739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 207/403] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:48 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:48.500298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 197/404] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:48 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:48.876134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:48.876834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:48.879382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:48.883326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:48.884401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:48.887419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.888073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.888456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.889168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.889626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.890041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.892799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.893526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.894444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:48.897173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:48.897693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:48.898182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:49.104415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:49.107516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:49.115171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d1275af0-1d88-4764-8899-ab3b18423c26 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.236795 Aug 05 05:16:49.129046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4d78ee34-ad29-429c-ae46-bd20c587643e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.244010 Aug 05 05:16:49.129299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 198/405] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:48 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:49.129299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-983b32dd-f3d1-47f0-b830-8b756d47dc34 req-f92a09c9-2937-4273-8c3f-3e8cd64cdadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "name": "network-vif-plugged", "status": "completed", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:49.129477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 208/406] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:48 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:49.133077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-983b32dd-f3d1-47f0-b830-8b756d47dc34 req-f92a09c9-2937-4273-8c3f-3e8cd64cdadd service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:49.133651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-983b32dd-f3d1-47f0-b830-8b756d47dc34 req-f92a09c9-2937-4273-8c3f-3e8cd64cdadd service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:49.134141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-983b32dd-f3d1-47f0-b830-8b756d47dc34 req-f92a09c9-2937-4273-8c3f-3e8cd64cdadd service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:49.146593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-983b32dd-f3d1-47f0-b830-8b756d47dc34 req-f92a09c9-2937-4273-8c3f-3e8cd64cdadd service nova] Creating event network-vif-plugged:fce17f2c-7a6f-4061-9c80-3211fcf7ac05 for instance 5edf8301-151e-4713-83c9-fe12e7517fe0 on hv-cinder-81558 Aug 05 05:16:49.152641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-983b32dd-f3d1-47f0-b830-8b756d47dc34 req-f92a09c9-2937-4273-8c3f-3e8cd64cdadd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034975 Aug 05 05:16:49.153480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 199/407] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:16:49.524924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:49.526100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:49.528665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:49.530188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:49.539204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:49.540113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:49.540863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:49.542375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:49.542655 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:49.543007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:49.543327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:49.543465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:49.543989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:49.544690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:49.545154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:49.545578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:49.738720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:49.742050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:49.746712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c9b1f023-4913-4970-b6c0-55cb5f6e68d2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.228392 Aug 05 05:16:49.747665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 209/408] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:49 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:49.757383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:49.758884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:49.760092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-67041ef4-7bd5-4fe4-8847-65aaddd9597a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.240194 Aug 05 05:16:49.760654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 200/409] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:49 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:50.141160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:50.142029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:50.142199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:50.142791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:50.152785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.153007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.153271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.153412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.153701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.153851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.154392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.154536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.154872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.155071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.155241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.155370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.353420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:50.358413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:50.361722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8dcaed4b-cd2d-404f-b4b5-0fe79627831e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.226554 Aug 05 05:16:50.362299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 201/410] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:50 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:50.366925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-82200223-86a9-4f3b-89a3-30b06a715dd0 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.232523 Aug 05 05:16:50.367487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 210/411] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:50 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:50.768251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:50.768930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:50.775485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.776090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.776584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.777430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.778531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.778953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:50.783619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:50.790910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.791399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.791876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.792581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:50.793031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:50.793450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:50.982260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:50.985614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:50.991049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c382bf5c-5ea3-486a-973b-7efeb6113637 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.226816 Aug 05 05:16:50.991655 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 202/412] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:50 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:50.995185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:50.996850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:50.998726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ca1a34d1-374b-4655-a9d4-f84cf8f4735e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1808 microversion: 2.20 time: 0.219901 Aug 05 05:16:50.999606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 211/413] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:50 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:16:51.168253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-292ee919-fd69-439d-ac17-010a506fe3a3 req-7aadbce5-6826-44a3-b822-79ed0e04cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "name": "network-vif-plugged", "status": "completed", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:51.177776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-292ee919-fd69-439d-ac17-010a506fe3a3 req-7aadbce5-6826-44a3-b822-79ed0e04cc4d service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:51.178248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-292ee919-fd69-439d-ac17-010a506fe3a3 req-7aadbce5-6826-44a3-b822-79ed0e04cc4d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:51.178687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-292ee919-fd69-439d-ac17-010a506fe3a3 req-7aadbce5-6826-44a3-b822-79ed0e04cc4d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:51.189675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-292ee919-fd69-439d-ac17-010a506fe3a3 req-7aadbce5-6826-44a3-b822-79ed0e04cc4d service nova] Creating event network-vif-plugged:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:16:51.194535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-292ee919-fd69-439d-ac17-010a506fe3a3 req-7aadbce5-6826-44a3-b822-79ed0e04cc4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029943 Aug 05 05:16:51.195112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 203/414] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:16:51.382374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:51.382984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:51.389414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:51.389834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:51.390265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:51.390960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:51.391402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:51.391851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:51.393040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:51.393805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:51.400623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:51.401148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:51.401642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:51.402629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:51.403157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:51.403631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:51.599385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:51.607045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-401280df-2647-44bc-87d8-6a04705ea968 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.228496 Aug 05 05:16:51.607392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:51.608909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 212/415] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:51 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:51.616464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2442c7ef-6e36-4bac-ba13-5a99286a10e5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.228379 Aug 05 05:16:51.617190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 204/416] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:51 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:52.013100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:52.013944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:52.021306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.021784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.022430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.023280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.023730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.024187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.024284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:52.024915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:52.031586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.032099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.032525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.033212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.033646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.034055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.226205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:52.231232 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:52.236768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9387b2db-b281-4e49-8983-634047af0043 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.227471 Aug 05 05:16:52.237558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 213/417] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:52 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:52.241671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:52.243149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:52.244322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-87e391a4-36b8-4772-ac56-68dd4215e23a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1795 microversion: 2.20 time: 0.226230 Aug 05 05:16:52.244883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 205/418] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:16:52 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1795 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:16:52.629104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:52.629709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:52.637127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.637715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.638168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.638791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:52.638935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.639280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.639458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:52.639697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.645696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.646194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.646610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.647297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:52.647744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:52.648194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:52.654432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:52.831094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:52.835404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:52.839509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0d24bb4f-2e13-47a2-8de0-c0925c771d65 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1359 microversion: 2.1 time: 0.214457 Aug 05 05:16:52.840110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 214/419] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:52 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:52.844352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a1094880-d382-4037-af19-d6c6a46d5ff7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.209976 Aug 05 05:16:52.844913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 206/420] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:52 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:53.262323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:53.263038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:53.270257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:53.270747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:53.271173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:53.271914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:53.272363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:53.272784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:53.402092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:53.410187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5e03af1a-79aa-4aec-a9d7-76b9a7f971f2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.154597 Aug 05 05:16:53.410762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 215/421] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:53 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:53.863827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:53.864797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:53.871653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:53.872489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:53.874381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:53.874869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:53.875295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:53.876026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:53.876473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:53.876884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:53.878622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:53.879096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:53.879525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:53.880229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:53.880653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:53.881087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.068004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:54.071119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:54.075906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ca035e63-3aa5-41e2-a319-76d24191d7a4 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1549 microversion: 2.1 time: 0.218433 Aug 05 05:16:54.076471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 207/422] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:53 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1549 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:54.079528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e297fd19-02c6-4537-9e15-68a305aafaa9 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.214271 Aug 05 05:16:54.080084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 216/423] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:53 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:54.095627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:54.096272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:54.102191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.102675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.103106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.103815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.104289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.104707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.238418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:54.246168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-225f4606-e0d4-44d9-ad04-17a1f973ac3d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1549 microversion: 2.1 time: 0.154208 Aug 05 05:16:54.246709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 208/424] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:54 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:54.266172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:54.270935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:54.271698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Searching by: {'deleted': False, 'project_id': '28b64940359146368434f38f443b5afd'} {{(pid=117902) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 05:16:54.278873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.279412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.280012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.280550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.280984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.281393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.370715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.multi_cell_list [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 05:16:54.431736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:54.432476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:54.438851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.439332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.439801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.440583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.440976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.441422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.464518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7a8fd291-064b-46a7-ba53-4efb7d01ec57 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202191 Aug 05 05:16:54.465093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 217/425] 10.222.0.30 () {58 vars in 1125 bytes} [Fri Aug 5 05:16:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:16:54.476205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:54.476815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:54.483056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.483538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.483994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.484683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:54.485132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:54.485547 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:54.629398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:54.637421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4a69018c-dc04-41f0-9b4b-7b8156463685 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.209641 Aug 05 05:16:54.637970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 209/426] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:54 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:54.657883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:54.665938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-749c0a54-15b6-4cfe-9c41-5287f6347a5b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1549 microversion: 2.1 time: 0.193388 Aug 05 05:16:54.666498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 218/427] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:54 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:55.101757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:55.102296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:55.109271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:55.109801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:55.110228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:55.110994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:55.111493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:55.111971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:55.243519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:55.251852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a47dd6fe-26fb-46cc-ae30-52c2131ba937 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.154177 Aug 05 05:16:55.252461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 210/428] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:55 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:55.665247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:55.666259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:55.674444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:55.674915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:55.675336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:55.676048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:55.676492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:55.676907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:55.806630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:55.814404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1c3b9e29-c5be-42a3-bffc-3d469252f948 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.156568 Aug 05 05:16:55.814964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 219/429] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:55 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:56.238949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a297955d-7276-44a6-b820-34edb48a3f49"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:56.241406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:56.248332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:56.248818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:56.249241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:56.249918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:56.250360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:56.250772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:56.273372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:56.273905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:56.280588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:56.281049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:56.281662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:56.282366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:56.282820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:56.283241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:56.431697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:56.440497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e575b3c7-4e92-4ceb-9694-479599c09c4e tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.171020 Aug 05 05:16:56.441078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 220/430] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:56 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:56.528803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:16:56.539477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-653158bb-40c0-45a5-8aa4-1674c96f2cdd tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304381 Aug 05 05:16:56.540128 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 211/431] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:16:56 2022] POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:16:56.839332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:56.840303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:56.847846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:56.848325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:56.848755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:56.849437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:56.849882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:56.850297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:56.988101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:57.001084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9dd598e8-66e1-4cda-bd74-7ff7629bd718 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1677 microversion: 2.1 time: 0.168101 Aug 05 05:16:57.001755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 221/432] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:56 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:57.468346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:57.469037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:57.475672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:57.476139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:57.476610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:57.477299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:57.477749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:57.478172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:57.616785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:57.624994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8acec1bb-b4d6-4d12-8ea7-d9b848a08bc6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.164968 Aug 05 05:16:57.625572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 212/433] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:57 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:58.022413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:58.023005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:58.029980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.030468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.030899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.031591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.032091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.032513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.168730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:58.176621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2f6e722e-e817-41d3-921f-f459e452ff44 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1654 microversion: 2.1 time: 0.158094 Aug 05 05:16:58.177188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 222/434] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:58 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:58.196948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c67ace63-6a79-4712-865b-1d5304e809b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:16:58.203714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c67ace63-6a79-4712-865b-1d5304e809b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.204437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c67ace63-6a79-4712-865b-1d5304e809b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.204668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c67ace63-6a79-4712-865b-1d5304e809b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.226325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c67ace63-6a79-4712-865b-1d5304e809b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Going to try to start instance {{(pid=117903) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 05:16:58.270893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c67ace63-6a79-4712-865b-1d5304e809b1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action" status: 202 len: 0 microversion: 2.1 time: 0.077677 Aug 05 05:16:58.271472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 213/435] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:16:58 2022] POST /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:16:58.279742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:58.280473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:58.286891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.287405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.288275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.289019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.289503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.289929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.423466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:58.431206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f323de65-b631-408e-bb43-549df66b688e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1663 microversion: 2.1 time: 0.155400 Aug 05 05:16:58.431788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 223/436] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:58 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:58.647144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:58.647963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:58.654381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.654849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.655284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.656010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:58.656461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:58.656882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:58.788546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:58.797182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d724fb35-a333-4e21-a3bb-0b62171448f8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.154366 Aug 05 05:16:58.797754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 214/437] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:58 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:59.454689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:59.455327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:59.462346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:59.462791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:59.463249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:59.463964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:59.464408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:59.464817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:59.604554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:59.616822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-991373e5-0097-4f23-94bc-2e652c338a2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1663 microversion: 2.1 time: 0.166648 Aug 05 05:16:59.617627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 224/438] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:59 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:16:59.818662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:16:59.819237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:16:59.826172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:59.826654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:59.827087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:59.827793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:16:59.828251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:16:59.828666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:16:59.961727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:16:59.969911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b3adf519-9c74-4286-ab3c-206ea80e58e3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.155152 Aug 05 05:16:59.970486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 215/439] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:16:59 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:00.644309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:00.645296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:00.655939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:00.656420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:00.656851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:00.657546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:00.657994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:00.658413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:00.798141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:00.805697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c8898857-7ff8-4c34-8ad9-d060ea45ff06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1667 microversion: 2.1 time: 0.168012 Aug 05 05:17:00.806263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 225/440] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:00 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:01.000044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:01.001192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:01.012605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:01.013452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:01.014024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:01.014772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:01.015222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:01.015642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:01.155496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:01.164173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4bc70a5a-0bf2-48bc-9222-abf0bf562feb tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.171529 Aug 05 05:17:01.164751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 216/441] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:00 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:02.188160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:02.188804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:02.195726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:02.196246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:02.196678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:02.197412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:02.197846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:02.198268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:02.328496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:02.336866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fb93731c-e01c-4471-a3bb-8e49f3cd07f4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.153694 Aug 05 05:17:02.337454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 226/442] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:02 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:03.359398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:03.360004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:03.366185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:03.366664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:03.367106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:03.367776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:03.368232 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:03.368646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:03.498647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:03.507067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d32ff59f-3604-4de0-8de0-da5bf30921b2 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.151582 Aug 05 05:17:03.507647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 217/443] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:03 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:04.168705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:04.169393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:04.179288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:04.180017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:04.180571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:04.181566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:04.182218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:04.182773 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:04.312025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:04.326513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:04.335084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cb80d085-02df-409a-b4fa-034b50029092 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1595 microversion: 2.1 time: 0.170918 Aug 05 05:17:04.335663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 227/444] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:04 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:04.529899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:04.530441 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:04.539644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:04.540169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:04.540596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:04.541285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:04.542264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:04.542745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:04.747190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:04.755203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6c6f701-d5b7-41de-b462-1b7f3330b980 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.231136 Aug 05 05:17:04.755926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 218/445] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:04 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:05.779468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:05.780349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:05.787501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:05.788442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:05.788906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:05.789620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:05.790075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:05.790547 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:05.972691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:05.982305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-98763975-fc44-449a-b090-4c95bc03678a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.208016 Aug 05 05:17:05.983091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 228/446] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:05 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:06.513111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-667ec2ac-6c94-4e8a-a468-8699f7520698 req-1f57ddd3-5ee9-4c29-a300-a28a0b2a54a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:06.522970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-667ec2ac-6c94-4e8a-a468-8699f7520698 req-1f57ddd3-5ee9-4c29-a300-a28a0b2a54a5 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:06.523440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-667ec2ac-6c94-4e8a-a468-8699f7520698 req-1f57ddd3-5ee9-4c29-a300-a28a0b2a54a5 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:06.523902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-667ec2ac-6c94-4e8a-a468-8699f7520698 req-1f57ddd3-5ee9-4c29-a300-a28a0b2a54a5 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:06.539309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-667ec2ac-6c94-4e8a-a468-8699f7520698 req-1f57ddd3-5ee9-4c29-a300-a28a0b2a54a5 service nova] Creating event network-changed:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:17:06.544888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-667ec2ac-6c94-4e8a-a468-8699f7520698 req-1f57ddd3-5ee9-4c29-a300-a28a0b2a54a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035407 Aug 05 05:17:06.546086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 219/447] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:07.004057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:07.005214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:07.012192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:07.013018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:07.013732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:07.014660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:07.015378 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:07.016029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:07.185091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:07.198283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d3e02ea4-b9e5-4a42-ab32-edc61aeaf7b6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.198038 Aug 05 05:17:07.199426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 229/448] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:06 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:07.585551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-366133737"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:07.586144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:07.592296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:07.592795 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:07.593242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:07.593917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:07.594356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:07.594787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:07.726208 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.network.security_group_api [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Adding security group bd53615b-eb97-430d-be54-37d56f6e31b0 to port 38b31332-3a4e-48c6-818c-271880cf2489 Aug 05 05:17:08.052471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0634b0da-45c4-4db1-9b05-af67514f8a7a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/action" status: 202 len: 0 microversion: 2.1 time: 0.471693 Aug 05 05:17:08.053172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 220/449] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:17:07 2022] POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:17:08.061593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:08.062203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:08.069113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:08.069710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:08.070212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:08.070910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:08.071360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:08.072493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:08.219894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:08.220106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:08.220740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:08.222300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:08.227383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:08.227915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:08.228344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:08.229040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:08.229667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:08.230094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:08.230201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cd052e41-0140-4f05-a3a8-339e619bd64c tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1759 microversion: 2.1 time: 0.172716 Aug 05 05:17:08.231845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 230/450] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:08 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:17:08.361507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:08.369829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1dfbaeba-846e-42ef-9f42-45e35faa9970 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.153682 Aug 05 05:17:08.370370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 221/451] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:08 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:17:08.562028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-bf5949cc-9c66-4641-89ac-a53d3fe23d2d req-ed450906-576f-40cb-8c35-80e27d77e4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:08.573717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-bf5949cc-9c66-4641-89ac-a53d3fe23d2d req-ed450906-576f-40cb-8c35-80e27d77e4a1 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:08.574344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-bf5949cc-9c66-4641-89ac-a53d3fe23d2d req-ed450906-576f-40cb-8c35-80e27d77e4a1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:08.574781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-bf5949cc-9c66-4641-89ac-a53d3fe23d2d req-ed450906-576f-40cb-8c35-80e27d77e4a1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:08.586985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-bf5949cc-9c66-4641-89ac-a53d3fe23d2d req-ed450906-576f-40cb-8c35-80e27d77e4a1 service nova] Creating event network-changed:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:17:08.592512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-bf5949cc-9c66-4641-89ac-a53d3fe23d2d req-ed450906-576f-40cb-8c35-80e27d77e4a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035683 Aug 05 05:17:08.593125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 231/452] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:09.396295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:09.397163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:09.406613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:09.407091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:09.407521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:09.408234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:09.408676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:09.409088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:09.757214 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:09.770830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-49213a53-775f-48b7-94a1-a2ac7e4c9126 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.380965 Aug 05 05:17:09.771606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 222/453] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:09 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:10.796958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:10.797605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:10.804238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:10.804720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:10.805147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:10.805825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:10.806268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:10.806682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:10.948645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:10.961488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4228df21-8cfa-4707-ae8c-a3140f837779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1737 microversion: 2.1 time: 0.170944 Aug 05 05:17:10.962315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 232/454] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:10 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:11.983118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:11.983657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:11.990471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:11.991005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:11.991418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:11.992250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:11.992706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:11.993112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.121460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:12.129869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-486a2a88-4981-45cd-82d0-ed5f86cbdc29 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1717 microversion: 2.1 time: 0.151060 Aug 05 05:17:12.130444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 223/455] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:11 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:12.254518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:12.255091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:12.263891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:12.264372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:12.264799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.265477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:12.265920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:12.266330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.351946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] HTTP exception thrown: Cannot 'detach_volume' instance bed093e9-77c9-43a3-b480-77d26728cb34 while it is in vm_state rescued Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Request method failure captured: Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments/a40cce27-919a-4f17-a4ff-01ba747d7b2b HTTP/1.1 Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KbulsjSmVXWUZbWw2tL7fu3Wi_gaLJoQm4LnvR3EQfPN-z9TY7sqyVojnvPfqOtrgPpHbUoytSLKkl6UtPzp9ebFaWHV_yo1mQCGHCBP-HdqwMabsvj20MTYKRNT4lPg7tiAbBDIXZu1-5X9NDqCdLgeQm8MYhYYosLcYtzbW34EFQ Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:17:12.353578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b672d5801cb4fdf87d6626f4603e281", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c7c57f5e11a84bf98d474837adbb0ba7 Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:17:12.355028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Cannot 'detach_volume' instance bed093e9-77c9-43a3-b480-77d26728cb34 while it is in vm_state rescued Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'server_id': 'bed093e9-77c9-43a3-b480-77d26728cb34', 'id': 'a40cce27-919a-4f17-a4ff-01ba747d7b2b'} Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bed093e9-77c9-43a3-b480-77d26728cb34 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:17:12.355968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bed093e9-77c9-43a3-b480-77d26728cb34 while it is in vm_state rescued Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bed093e9-77c9-43a3-b480-77d26728cb34 while it is in vm_state rescued Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:12.357541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Returning 409 to user: Cannot 'detach_volume' instance bed093e9-77c9-43a3-b480-77d26728cb34 while it is in vm_state rescued {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:17:12.358787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fd518e01-eb6d-48cf-ac20-4d594805fae6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments/a40cce27-919a-4f17-a4ff-01ba747d7b2b" status: 409 len: 152 microversion: 2.1 time: 0.104562 Aug 05 05:17:12.358787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 233/456] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:17:12 2022] DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments/a40cce27-919a-4f17-a4ff-01ba747d7b2b => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 05:17:12.364327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:12.364875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:12.371088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:12.371559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:12.372049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.372836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:12.373290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:12.373713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.442349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ee2a97b9-aa91-48ef-a428-41891d85da3d tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "POST /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/action" status: 202 len: 0 microversion: 2.1 time: 0.081342 Aug 05 05:17:12.443309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 224/457] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:17:12 2022] POST /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:17:12.451741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:12.452666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:12.458990 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:12.459687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:12.460216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.460920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:12.461423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:12.461938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:12.605350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:12.613572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2c8c803d-3e30-46f8-a5ba-8a71b5708cda tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1725 microversion: 2.1 time: 0.165796 Aug 05 05:17:12.614111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 234/458] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:12 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:13.639309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:13.640065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:13.646790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:13.647273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:13.647695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:13.648510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:13.648991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:13.649403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:13.792454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:13.800963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-000423d2-acf8-4d6c-b1f1-409fc0902fca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1725 microversion: 2.1 time: 0.168576 Aug 05 05:17:13.801528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 225/459] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:13 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:14.822589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:14.823179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:14.830283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:14.830770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:14.831204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:14.831933 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:14.832386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:14.832813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:14.963461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:14.972184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-db8ac810-3bad-41e8-ace6-9329f9b4a6be tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1725 microversion: 2.1 time: 0.153486 Aug 05 05:17:14.972768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 235/460] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:14 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:15.993385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:15.994149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:15.996509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=70 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:16.002961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:16.003447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:16.003915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:16.004608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:16.005059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:16.005476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:16.137640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:16.145938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eae1899a-fb1f-423e-ab95-db5fbbb8acc4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1731 microversion: 2.1 time: 0.156532 Aug 05 05:17:16.146508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 226/461] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:15 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:16.166849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:16.167399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:16.173929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:16.174405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:16.174829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:16.175490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:16.175966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:16.176379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:16.253868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7c7c70cb-df88-45cb-860e-1a92873f6c5a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091179 Aug 05 05:17:16.254536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 236/462] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:17:16 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:17.198816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-e1f91894-7dd1-4187-a2d6-d49cf9822559 req-377d20ce-2f95-46c9-bd6f-df7d22dca372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed093e9-77c9-43a3-b480-77d26728cb34", "tag": "232fe0eb-f94f-4739-bf4b-435ded0bfd05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:17.209650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-e1f91894-7dd1-4187-a2d6-d49cf9822559 req-377d20ce-2f95-46c9-bd6f-df7d22dca372 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:17.210364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-e1f91894-7dd1-4187-a2d6-d49cf9822559 req-377d20ce-2f95-46c9-bd6f-df7d22dca372 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:17.210855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-e1f91894-7dd1-4187-a2d6-d49cf9822559 req-377d20ce-2f95-46c9-bd6f-df7d22dca372 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:17.223992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-e1f91894-7dd1-4187-a2d6-d49cf9822559 req-377d20ce-2f95-46c9-bd6f-df7d22dca372 service nova] Creating event network-changed:232fe0eb-f94f-4739-bf4b-435ded0bfd05 for instance bed093e9-77c9-43a3-b480-77d26728cb34 on hv-cinder-81558 Aug 05 05:17:17.228950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-e1f91894-7dd1-4187-a2d6-d49cf9822559 req-377d20ce-2f95-46c9-bd6f-df7d22dca372 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Aug 05 05:17:17.229972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 227/463] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:19.249342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-4e0dcda4-09db-4a7b-8f71-907ec7bf1942 req-729354b5-dafb-41c4-9bda-75f36dc02cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed093e9-77c9-43a3-b480-77d26728cb34", "tag": "232fe0eb-f94f-4739-bf4b-435ded0bfd05"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:19.254245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=58 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:19.259966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-4e0dcda4-09db-4a7b-8f71-907ec7bf1942 req-729354b5-dafb-41c4-9bda-75f36dc02cd5 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:19.260435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-4e0dcda4-09db-4a7b-8f71-907ec7bf1942 req-729354b5-dafb-41c4-9bda-75f36dc02cd5 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:19.260853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-4e0dcda4-09db-4a7b-8f71-907ec7bf1942 req-729354b5-dafb-41c4-9bda-75f36dc02cd5 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:19.273724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-4e0dcda4-09db-4a7b-8f71-907ec7bf1942 req-729354b5-dafb-41c4-9bda-75f36dc02cd5 service nova] Creating event network-changed:232fe0eb-f94f-4739-bf4b-435ded0bfd05 for instance bed093e9-77c9-43a3-b480-77d26728cb34 on hv-cinder-81558 Aug 05 05:17:19.279047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-4e0dcda4-09db-4a7b-8f71-907ec7bf1942 req-729354b5-dafb-41c4-9bda-75f36dc02cd5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035846 Aug 05 05:17:19.279678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 237/464] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:33.797093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:33.798238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:33.805067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:33.808923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:33.817162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.817643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.818065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.818746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.819192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.819612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.830202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=33 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:33.830939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:33.835647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:33.836272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:33.843200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.843672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.844126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.844802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.845234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.845646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.883372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ece6b727-5a84-4a45-a93a-a55e02d3f9ae tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments/f13f815a-1482-46fc-8161-8ac9385d331a" status: 200 len: 194 microversion: 2.20 time: 0.054517 Aug 05 05:17:33.890775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 238/465] 10.222.0.30 () {60 vars in 1454 bytes} [Fri Aug 5 05:17:33 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments/f13f815a-1482-46fc-8161-8ac9385d331a => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 05:17:33.897741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-77b744e5-acd7-47e3-ba6d-ddfc65225a4b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/action" status: 202 len: 0 microversion: 2.1 time: 0.103316 Aug 05 05:17:33.898566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 228/466] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:17:33 2022] POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:17:33.908004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:33.908695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:33.915419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.916335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.916449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.917070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.917563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.918000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.960871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:33.961454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:33.968026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.968511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.968944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:33.969690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:33.971368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:33.971835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:34.079574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:34.088942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ec30bc65-940b-4b75-8b6f-5847548cc5f8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1751 microversion: 2.1 time: 0.185529 Aug 05 05:17:34.089600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 239/467] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:33 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:34.105931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lazy-loading 'services' on Instance uuid 5edf8301-151e-4713-83c9-fe12e7517fe0 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:17:34.219869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-16e3a45d-c661-4509-acc9-73b278f996a4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments/f13f815a-1482-46fc-8161-8ac9385d331a" status: 202 len: 0 microversion: 2.20 time: 0.263351 Aug 05 05:17:34.220497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 229/468] 10.222.0.30 () {60 vars in 1457 bytes} [Fri Aug 5 05:17:33 2022] DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments/f13f815a-1482-46fc-8161-8ac9385d331a => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 05 05:17:34.229009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:34.231237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:34.237595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:34.238045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:34.238476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:34.239167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:34.239657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:34.240081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:34.269839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1d4fbac2-3af4-4c84-acd8-fc40df61e764 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Aug 05 05:17:34.270423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 240/469] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Aug 5 05:17:34 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:17:35.113223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:35.113921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:35.120252 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:35.120786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:35.121145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:35.121796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:35.122265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:35.122652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:35.276784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:35.282610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:35.284862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:35.285660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e12b8a3a-ee8d-4020-afde-7de504175871 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.177146 Aug 05 05:17:35.286223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 230/470] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:35 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:35.292054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:35.292539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:35.292968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:35.293664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:35.294101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:35.294567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:35.324033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d0804131-041a-4222-9380-ea3c7741c7d7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045532 Aug 05 05:17:35.324601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 241/471] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Aug 5 05:17:35 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:17:36.312449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:36.313356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:36.324172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.324976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.325802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.326497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.326946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.327372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.337115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:36.339233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:36.346016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.346504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.346938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.347631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.348120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.348535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.378378 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dbc5c18e-900d-4e18-8ec5-c3581ce4c06b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045175 Aug 05 05:17:36.378949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 242/472] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Aug 5 05:17:36 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:17:36.440917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:36.441535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:36.447698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.448180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.448606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.449296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.449736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.450359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.472018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:36.474668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:17:36.480428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c83db084-6bec-479e-8ba4-a523179ca03a tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.174984 Aug 05 05:17:36.481002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 231/473] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:36 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:36.551395 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9f789a4a-595b-4e55-a5f5-a9e9b2c830f3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 204 len: 0 microversion: 2.20 time: 0.114072 Aug 05 05:17:36.552224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 243/474] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Aug 5 05:17:36 2022] DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 05:17:36.562161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:36.562965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:36.568784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.569257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.569682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.570355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:36.570798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:36.571210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:36.701212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:36.709617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:36.711171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:36.712582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2d9fc89a-acd1-4806-9ed2-3e1611ec3e7f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.155457 Aug 05 05:17:36.713149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 232/475] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:36 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:37.507278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:37.508445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:37.517207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:37.517717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:37.518150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:37.518836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:37.519283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:37.519702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:37.672970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:37.681835 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-52bb5463-871b-40be-bdfd-3e3238c5863e tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.181844 Aug 05 05:17:37.682447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 244/476] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:37 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:37.740039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:37.741030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:37.751974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:37.752737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:37.753463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:37.754591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:37.755322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:37.756053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:37.891360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:37.900129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:37.901631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:37.902784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c3ee7f09-0c36-463d-9b12-c28f46d876c0 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.169581 Aug 05 05:17:37.903349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 233/477] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:37 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:38.703215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:38.704021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:38.710550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:38.711034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:38.711454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:38.712165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:38.712607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:38.713015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:38.857734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:38.865969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-73efa3e0-4f21-46a2-b2e8-a09835525a05 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.166997 Aug 05 05:17:38.866726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 245/478] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:38 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:38.926512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:38.927534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:38.933673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:38.934152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:38.934577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:38.935386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:38.935868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:38.936285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:39.070004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:39.078398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:39.079913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:39.081072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bcd723ce-b7d1-4e73-9a1d-cb7b6083b1dc tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1723 microversion: 2.20 time: 0.158721 Aug 05 05:17:39.081605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 234/479] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:38 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:39.491112 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-1882652c-f9bc-40cf-a79f-3e3631d88aab req-01fb3cc7-c591-4381-b0f8-fc5d551bc84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edf8301-151e-4713-83c9-fe12e7517fe0", "name": "network-vif-deleted", "tag": "fce17f2c-7a6f-4061-9c80-3211fcf7ac05"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:39.505464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1882652c-f9bc-40cf-a79f-3e3631d88aab req-01fb3cc7-c591-4381-b0f8-fc5d551bc84d service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:39.506032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1882652c-f9bc-40cf-a79f-3e3631d88aab req-01fb3cc7-c591-4381-b0f8-fc5d551bc84d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:39.506531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1882652c-f9bc-40cf-a79f-3e3631d88aab req-01fb3cc7-c591-4381-b0f8-fc5d551bc84d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:39.520066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-1882652c-f9bc-40cf-a79f-3e3631d88aab req-01fb3cc7-c591-4381-b0f8-fc5d551bc84d service nova] Creating event network-vif-deleted:fce17f2c-7a6f-4061-9c80-3211fcf7ac05 for instance 5edf8301-151e-4713-83c9-fe12e7517fe0 on hv-cinder-81558 Aug 05 05:17:39.529691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-1882652c-f9bc-40cf-a79f-3e3631d88aab req-01fb3cc7-c591-4381-b0f8-fc5d551bc84d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042396 Aug 05 05:17:39.539647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 246/480] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:39.888037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:39.888793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:39.895141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:39.895710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:39.896239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:39.897031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:39.897578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:39.898081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:40.048999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:40.057548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6ea4eaea-2f8c-494d-867a-0a88437f16a8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.173508 Aug 05 05:17:40.058119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 235/481] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:39 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:40.105613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:40.107200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:40.114480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:40.115205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:40.115823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:40.116788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:40.117466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:40.117987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:40.153598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:40.154399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:40.155659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:40.156188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lazy-loading 'fault' on Instance uuid 5edf8301-151e-4713-83c9-fe12e7517fe0 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:17:40.209153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:40.222350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:40.223906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:40.225084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-16340869-2ed8-4c35-b81f-2f79d8186122 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 200 len: 1371 microversion: 2.20 time: 0.124698 Aug 05 05:17:40.231829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 247/482] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:40 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:41.079009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:41.079643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:41.086524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:41.087010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:41.087439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:41.089103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:41.089717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:41.090139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:41.246414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:41.248558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:41.249176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:41.256390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b74d7482-880b-4702-be7e-7bb0ce110e3b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.181107 Aug 05 05:17:41.257106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 236/483] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:41 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:41.257261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:41.257721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:41.258168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:41.258898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:41.259360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:41.259974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:41.274891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] HTTP exception thrown: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Request method failure captured: Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 HTTP/1.1 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7Kbw6-0a-UtyiFf37k-6tHNjGVFFHpsJMMwK_nmDb6YRPKPv3Hv-wIx7HMA-O8z4hDf-lGylkWQF2ZFUjXASYWTx79iaYJ_4MHFQN5FbSabVsWzTm0zbth0K106j2dYkKGEOk8ukxJJAM3coYStYROPCySm7Ir4RuIQgs5g2EVUwVwg Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:17:41.277307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e43f69b71a364a63850d3008309e0c68", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: b89279618557486f9d5b358b654a906e Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:17:41.278985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '5edf8301-151e-4713-83c9-fe12e7517fe0'} Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:17:41.282861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:17:41.284769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:17:41.286041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Returning 404 to user: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:17:41.286041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e9b4b61c-2d22-430e-a711-59218586e890 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 404 len: 111 microversion: 2.20 time: 0.034148 Aug 05 05:17:41.286041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 248/484] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:41 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:17:41.288712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f4a00ee9-181e-4035-9c6c-da5814d10379 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '.version_select at 0x7fdc9db221f0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:41.309583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f4a00ee9-181e-4035-9c6c-da5814d10379 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109074787" status: 204 len: 0 microversion: 2.20 time: 0.025068 Aug 05 05:17:41.310156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 237/485] 10.222.0.30 () {60 vars in 1262 bytes} [Fri Aug 5 05:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109074787 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 05:17:41.975636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fdb863ce-363f-452c-af15-726140e84264 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'create', calling method: .version_select at 0x7fdc9da9fc10>, body: {"keypair": {"name": "tempest-keypair-2046858209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvyG78ezlIGDopKic2mh1g9Q2Spxt221onkVp9nA/gMMsK2VWK91Xj/+wx9FDGR74RIAW59I5jo87AtEw8YQS2N0k7hFCVTkdcCMP9Q3OsxQHLebEJB1jMZ499bat7nrw=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:41.991385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-fdb863ce-363f-452c-af15-726140e84264 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for project e43f69b71a364a63850d3008309e0c68. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:17:41.998902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-fdb863ce-363f-452c-af15-726140e84264 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for user b89279618557486f9d5b358b654a906e and project e43f69b71a364a63850d3008309e0c68. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:17:42.025410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fdb863ce-363f-452c-af15-726140e84264 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053715 Aug 05 05:17:42.026033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 249/486] 10.222.0.30 () {62 vars in 1200 bytes} [Fri Aug 5 05:17:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 05:17:42.278532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:42.279123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:42.286343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.286823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.287680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.288819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.289489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.289960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.372848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:42.374986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:42.382050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.382456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.382894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.383573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.384057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.384472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.414699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-26a97978-6ecc-43fc-9a73-52dce31ebee9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046239 Aug 05 05:17:42.415709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 250/487] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:17:42 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:17:42.447477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:42.456624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ab580e90-1371-40df-aed2-db561dd00285 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.182636 Aug 05 05:17:42.457188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 238/488] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:42 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:42.488736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:42.489241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:42.495256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.495744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.496212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.496900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.497483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.497899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.522391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:17:42.600634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8cca8578-0ed4-42d4-a8ba-d55e47b59374 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 204 len: 0 microversion: 2.1 time: 0.115695 Aug 05 05:17:42.601223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 251/489] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:17:42 2022] DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:17:42.610050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:42.610705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:42.617097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.617579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.618004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.618700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:42.619200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:42.619549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:42.752153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:42.759735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bb284a3b-0b62-467e-9062-e550038c4f02 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1673 microversion: 2.1 time: 0.153961 Aug 05 05:17:42.760324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 239/490] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:42 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:17:43.299353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-869691996", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2011a265-bb45-44e0-bde0-703ac89b046e"}], "security_groups": [{"name": "tempest-securitygroup--1432507151"}], "key_name": "tempest-keypair-2046858209", "user_data": "}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:43.403966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] validate_networks() for [('2011a265-bb45-44e0-bde0-703ac89b046e', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:17:43.478450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:43.478993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:43.485454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:43.485945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:43.486375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:43.487063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:43.487546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:43.487987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:43.952617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:43.960910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-402b83a5-2ce7-4496-b600-4f9dfb97c097 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.486459 Aug 05 05:17:43.961451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 240/491] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:43 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:43.965990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:43.966613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:43.972645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:43.973129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:43.973526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:43.974240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:43.974683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:43.975099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:44.127879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:17:44.128317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:17:44.128779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:17:44.129209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:17:44.129607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:17:44.139281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:44.139758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:44.140224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:44.140937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:44.141413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:44.141831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:44.151935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:44.159042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for project e43f69b71a364a63850d3008309e0c68. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:17:44.159927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-77c981b1-732a-4193-b1e4-474d75f90c32 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1673 microversion: 2.1 time: 0.197492 Aug 05 05:17:44.160496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 241/492] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:43 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:44.163639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Getting quotas for user b89279618557486f9d5b358b654a906e and project e43f69b71a364a63850d3008309e0c68. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:17:44.175022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:17:44.177496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:17:44.226905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-358129c0-e2b3-4a8b-8756-516b61191a6c tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.932317 Aug 05 05:17:44.227601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 252/493] 10.222.0.30 () {62 vars in 1188 bytes} [Fri Aug 5 05:17:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 05:17:44.238738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-99434c3e-3c66-4289-aab7-9df798009f39 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:44.239417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-99434c3e-3c66-4289-aab7-9df798009f39 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:44.295437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-99434c3e-3c66-4289-aab7-9df798009f39 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:44.303809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-99434c3e-3c66-4289-aab7-9df798009f39 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:44.305402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-99434c3e-3c66-4289-aab7-9df798009f39 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:44.306619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-99434c3e-3c66-4289-aab7-9df798009f39 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1281 microversion: 2.20 time: 0.071917 Aug 05 05:17:44.307271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 242/494] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:44 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:44.982801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:44.983413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:44.991058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:44.991538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:44.992010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:44.993171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:44.993171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:44.993673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:45.145517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:45.149212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:45.154587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e663f017-b308-461e-bd85-7fa273387dc8 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.175943 Aug 05 05:17:45.155523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 253/495] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:44 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:45.181518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:45.182170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:45.189355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:45.189836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:45.190260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:45.190973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:45.191552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:45.191988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:45.320562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:45.329482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:45.330338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:45.331719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-06266ba2-de0e-4f53-b255-c37b289cb163 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1673 microversion: 2.1 time: 0.154047 Aug 05 05:17:45.332367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 243/496] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:45 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:45.351354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:45.351866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:45.352538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:45.353304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:45.353834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:45.354220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:45.423019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:45.432462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:45.434354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:45.435786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9ad1329a-a301-485c-82e0-989aa25927e2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1333 microversion: 2.20 time: 0.110346 Aug 05 05:17:45.436330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 254/497] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:45 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:17:45.800487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-fcbd55a0-51f7-4dd1-abe8-92bdb9402000 req-c92ee56e-765d-40f7-b11d-9198306bde90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0058bb72-4d0a-4cd2-ace4-549ebc5f018c", "name": "network-vif-deleted", "tag": "ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:45.810053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-fcbd55a0-51f7-4dd1-abe8-92bdb9402000 req-c92ee56e-765d-40f7-b11d-9198306bde90 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:45.810554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-fcbd55a0-51f7-4dd1-abe8-92bdb9402000 req-c92ee56e-765d-40f7-b11d-9198306bde90 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:45.810974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-fcbd55a0-51f7-4dd1-abe8-92bdb9402000 req-c92ee56e-765d-40f7-b11d-9198306bde90 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:45.822200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-fcbd55a0-51f7-4dd1-abe8-92bdb9402000 req-c92ee56e-765d-40f7-b11d-9198306bde90 service nova] Creating event network-vif-deleted:ab2ce4cb-a93d-4308-a1fc-5b5b8595b2b2 for instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c on hv-cinder-81558 Aug 05 05:17:45.828552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-fcbd55a0-51f7-4dd1-abe8-92bdb9402000 req-c92ee56e-765d-40f7-b11d-9198306bde90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Aug 05 05:17:45.829215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 244/498] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:46.176664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:46.178055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:46.184736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.185580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.186279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.186990 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.187957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.188099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.356114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:46.357598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:46.366028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.366665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.367324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.368532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.369313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.370945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.385577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:46.397818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:46.398878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-91370a64-82d1-4633-adca-919e9ee402da tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.225448 Aug 05 05:17:46.400046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 255/499] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:46 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:46.415200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.415934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.416514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.417181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lazy-loading 'fault' on Instance uuid 0058bb72-4d0a-4cd2-ace4-549ebc5f018c {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:17:46.458511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:46.459061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:46.466870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.467575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.468222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.469072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:46.469657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:46.470225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:46.496333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:46.507306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-56d087bf-703f-4e6a-969b-1c182d8856a5 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 200 len: 1327 microversion: 2.1 time: 0.156278 Aug 05 05:17:46.508887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 245/500] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:46 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 1327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:46.649964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:46.658738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:46.660273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:46.661587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-161067af-b632-4dba-a5a2-c1a4f4de27b7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.207225 Aug 05 05:17:46.663375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 256/501] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:46 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:47.267575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-bfe80caf-0f85-4885-b6d2-3c576d287d77 req-4d930bfd-00bc-4bad-b4fe-7f777d6b2d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:47.278379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bfe80caf-0f85-4885-b6d2-3c576d287d77 req-4d930bfd-00bc-4bad-b4fe-7f777d6b2d04 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.278845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bfe80caf-0f85-4885-b6d2-3c576d287d77 req-4d930bfd-00bc-4bad-b4fe-7f777d6b2d04 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.279392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bfe80caf-0f85-4885-b6d2-3c576d287d77 req-4d930bfd-00bc-4bad-b4fe-7f777d6b2d04 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.292743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-bfe80caf-0f85-4885-b6d2-3c576d287d77 req-4d930bfd-00bc-4bad-b4fe-7f777d6b2d04 service nova] Creating event network-changed:98cad295-2ec9-44a3-9512-556b38096e67 for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc on hv-cinder-81558 Aug 05 05:17:47.297817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-bfe80caf-0f85-4885-b6d2-3c576d287d77 req-4d930bfd-00bc-4bad-b4fe-7f777d6b2d04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Aug 05 05:17:47.298414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 246/502] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:47.422423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:47.423031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:47.429944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.430424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.430845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.431522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.432000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.432413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.530288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:47.530866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:47.537687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.538160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.538582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.539259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.539702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.540133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.554619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] HTTP exception thrown: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Request method failure captured: Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c HTTP/1.1 Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7Kbng02UfywowbLJkzlaE9JAlqvL6i2c00ZbPf3RsDjhcJ2MfuW3TVUM0Sj-NFrQn_-lQ-QhmxKOd1AVL1XWU9x21vHUgwzEBofLgMedUTmMLAFv2If4b2qYFNtn2W3u-JYLIS2HY5LTdw0_N2qm86WGRqqz5H6nnUlNQnMEWpsrAyc Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:17:47.556309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c58f39e03f42d5862a6a64194f5711", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 04eb412804c247908f8d377a42d1ea63 Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:17:47.557766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '0058bb72-4d0a-4cd2-ace4-549ebc5f018c'} Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:17:47.558787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:17:47.560445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:17:47.562115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Returning 404 to user: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:17:47.562115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9cdd1b6-c67f-4ca0-a04e-715b90dff366 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 404 len: 111 microversion: 2.1 time: 0.032357 Aug 05 05:17:47.562115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 247/503] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:47 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 05:17:47.566743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-222ee5c9-f9a0-4704-bc4b-30634d32df48 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '.version_select at 0x7fdc9dc6e8b0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:47.586835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-222ee5c9-f9a0-4704-bc4b-30634d32df48 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266663217" status: 202 len: 0 microversion: 2.1 time: 0.023780 Aug 05 05:17:47.587398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 248/504] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Aug 5 05:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266663217 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:17:47.675813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:47.685767 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4cd7ae0e-dbba-4052-b655-029c1c5cf5c1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.267186 Aug 05 05:17:47.686618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 257/505] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:47 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:47.688219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:47.689182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:47.696725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.697574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.698272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.699235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:47.699751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:47.700395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:47.877067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:47.886415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:47.887947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:47.889109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-41bef959-74ca-4a7e-8117-d2c67423ad5f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.207189 Aug 05 05:17:47.889653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 249/506] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:47 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:48.200570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2cdd2a08-f858-4d9c-aa67-4bb5d4072bc1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: .version_select at 0x7fdc9da67f70>, body: {"keypair": {"name": "tempest-keypair-1886871404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfE/Nyaw6X072YR9Wd1Lv9J0rh3uECb1/HnFy7UMOKVuQ6198h4nrKhPXMAw2o3NaFTDfvZMJ+VM3BPT8uktpQgUpY6l1IrOS+fIGfv9++nSEIOLGHbsneb1rz1WsqMuw=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:48.216422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-2cdd2a08-f858-4d9c-aa67-4bb5d4072bc1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for project 27c58f39e03f42d5862a6a64194f5711. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:17:48.220295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-2cdd2a08-f858-4d9c-aa67-4bb5d4072bc1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for user 04eb412804c247908f8d377a42d1ea63 and project 27c58f39e03f42d5862a6a64194f5711. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:17:48.245382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2cdd2a08-f858-4d9c-aa67-4bb5d4072bc1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048753 Aug 05 05:17:48.245995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 258/507] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:17:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:48.708383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:48.709013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:48.715674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:48.716199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:48.716633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:48.717336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:48.717842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:48.718259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:48.911889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:48.913643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:48.920017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:48.920486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:48.920915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:48.921606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:48.922277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:48.922871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:48.966767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:48.975279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a9bdd203-1b12-44a4-afa6-b4740231e0b1 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.270867 Aug 05 05:17:48.975863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 250/508] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:48 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:49.137392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:49.146176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:49.147695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:49.148874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4ce95d5f-1fdb-40dc-a8d2-5869921b4585 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.241708 Aug 05 05:17:49.149422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 259/509] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:48 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:17:49.732346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1035110623", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17181fe8-2fbd-4695-9e7f-4006b5acd444"}], "security_groups": [{"name": "tempest-securitygroup--1065810451"}], "key_name": "tempest-keypair-1886871404", "user_data": "}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:49.835233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] validate_networks() for [('17181fe8-2fbd-4695-9e7f-4006b5acd444', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:17:49.997096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:49.997708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:50.004836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:50.005348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:50.005913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:50.006605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:50.007074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:50.007488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:50.257754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:50.267152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-84ef5baf-b21e-48cd-91be-87abf1e03bf9 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.274000 Aug 05 05:17:50.267808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 260/510] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:49 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:50.273218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:50.274026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:50.280161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:50.280868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:50.281300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:50.282134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:50.282587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:50.283002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:50.292617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:17:50.293036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:17:50.293504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:17:50.293907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:17:50.294310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:17:50.303437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:50.303971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:50.304404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:50.305143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:50.305594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:50.306008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:50.322815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for project 27c58f39e03f42d5862a6a64194f5711. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:17:50.326840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Getting quotas for user 04eb412804c247908f8d377a42d1ea63 and project 27c58f39e03f42d5862a6a64194f5711. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:17:50.337901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:17:50.340448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:17:50.390529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a18bbe96-17df-4d7d-9d2b-31e7705b884e tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662528 Aug 05 05:17:50.391384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 251/511] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:17:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:17:50.401722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-aae2754b-1cbc-45c3-b216-0cc6f0c2d8a9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:50.402325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-aae2754b-1cbc-45c3-b216-0cc6f0c2d8a9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:50.418064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:50.427500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:50.429120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:50.430317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-91f0c75e-e0a9-4b81-bcfa-6c6afd0b7d30 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.161414 Aug 05 05:17:50.430948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 261/512] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:50 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:50.457881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-aae2754b-1cbc-45c3-b216-0cc6f0c2d8a9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:50.464779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-aae2754b-1cbc-45c3-b216-0cc6f0c2d8a9 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1238 microversion: 2.1 time: 0.066753 Aug 05 05:17:50.465354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 252/513] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:50 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:17:51.288853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:51.289466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:51.292575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:51.296168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:51.296647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:51.297080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:51.297992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:51.298424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:51.298839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:51.452906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:51.454235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:51.461200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:51.461728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:51.462390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:51.463308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:51.464040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:51.464664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:51.469874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:51.478473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f324ce51-0f6c-4130-b7d6-48a4886029b6 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1756 microversion: 2.1 time: 0.193939 Aug 05 05:17:51.480055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 262/514] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:51 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:51.485148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:51.485917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:51.492348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:51.494521 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:51.495021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:51.495949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:51.496601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:51.497200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:51.579009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:51.587147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f74f0c72-6c0f-4a24-9f61-312c00a8b138 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1234 microversion: 2.1 time: 0.105868 Aug 05 05:17:51.587724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 263/515] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:51 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1234 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:51.646633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:51.655656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:51.657885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:51.658999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e7861e41-1712-4173-a0f8-4949a31f51eb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.210088 Aug 05 05:17:51.659710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 253/516] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:51 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:17:52.500279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:52.501152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:52.508227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.508733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.509161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.509844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.510288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.510721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.588734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:52.589340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:52.596237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.596716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.597141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.597843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.598303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.598793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.687754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'services' on Instance uuid bed093e9-77c9-43a3-b480-77d26728cb34 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:17:52.766544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3d3099cd-3d8b-4f14-b772-5fed2feed5bf tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments/a40cce27-919a-4f17-a4ff-01ba747d7b2b" status: 202 len: 0 microversion: 2.1 time: 0.181612 Aug 05 05:17:52.767171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 254/517] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:17:52 2022] DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments/a40cce27-919a-4f17-a4ff-01ba747d7b2b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 05:17:52.772677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:52.773316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:52.780037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.780376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.780766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.781697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.782422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.782789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.873510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:52.882453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1c6d7ea4-6abb-40fc-a5f7-5c3af323893f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1296 microversion: 2.1 time: 0.114122 Aug 05 05:17:52.883333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 255/518] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:52 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:52.899468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:52.900091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:52.906307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.906788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.907314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:52.908280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:52.908698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:52.909110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:53.039547 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:53.048520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-16e69358-4f69-496e-bcbc-193d0571b3f3 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1759 microversion: 2.1 time: 0.552159 Aug 05 05:17:53.049159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 264/519] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:52 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1759 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:53.056031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:53.058481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:53.066310 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:53.066795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:53.067211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:53.067997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:53.068466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:53.068985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:53.101736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-788b38a0-7cfa-44ba-b9b1-2c0069258285 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051248 Aug 05 05:17:53.102237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 265/520] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:17:53 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:53.154560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:53.163373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:53.165089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:53.166213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-370e27e9-dae6-493f-996c-051967775872 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.270814 Aug 05 05:17:53.166764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 256/521] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:52 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:53.233629 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-d5969ada-ceb5-4d6d-b68a-e89eaf0efc88 req-ecbde1aa-4426-47ff-8260-56980e988a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:53.246403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-d5969ada-ceb5-4d6d-b68a-e89eaf0efc88 req-ecbde1aa-4426-47ff-8260-56980e988a58 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:53.246873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-d5969ada-ceb5-4d6d-b68a-e89eaf0efc88 req-ecbde1aa-4426-47ff-8260-56980e988a58 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:53.247290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-d5969ada-ceb5-4d6d-b68a-e89eaf0efc88 req-ecbde1aa-4426-47ff-8260-56980e988a58 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:53.261684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-d5969ada-ceb5-4d6d-b68a-e89eaf0efc88 req-ecbde1aa-4426-47ff-8260-56980e988a58 service nova] Creating event network-vif-plugged:98cad295-2ec9-44a3-9512-556b38096e67 for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc on hv-cinder-81558 Aug 05 05:17:53.267167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-d5969ada-ceb5-4d6d-b68a-e89eaf0efc88 req-ecbde1aa-4426-47ff-8260-56980e988a58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037846 Aug 05 05:17:53.268468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 266/522] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:17:53.903796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:53.906099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:53.913899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:53.914394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:53.914828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:53.915508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:53.916005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:53.916587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.096775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:54.105140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-147e9aa2-72b6-465e-a255-7af5c85c948d tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.205269 Aug 05 05:17:54.106284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 257/523] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:53 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:54.115298 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:54.117533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:54.126160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.126643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.127255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.128067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.128561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.128909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.139985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-6a31da3f-c7f3-4484-a5e9-e626e0b732ff req-82e8335c-e3c5-4507-a020-0ba7fa5dd29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f89ed-d391-4030-8013-2f436e3e3950", "tag": "0325c509-c7b4-45f1-bcfa-cc99cc230fb0"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:54.149180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:54.150100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-6a31da3f-c7f3-4484-a5e9-e626e0b732ff req-82e8335c-e3c5-4507-a020-0ba7fa5dd29e service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.150903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-6a31da3f-c7f3-4484-a5e9-e626e0b732ff req-82e8335c-e3c5-4507-a020-0ba7fa5dd29e service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.151511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-6a31da3f-c7f3-4484-a5e9-e626e0b732ff req-82e8335c-e3c5-4507-a020-0ba7fa5dd29e service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.161688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a931d6ee-b303-4ef6-b5f2-606e04b20779 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051878 Aug 05 05:17:54.162613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 267/524] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:17:54 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:17:54.164173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-6a31da3f-c7f3-4484-a5e9-e626e0b732ff req-82e8335c-e3c5-4507-a020-0ba7fa5dd29e service nova] Creating event network-changed:0325c509-c7b4-45f1-bcfa-cc99cc230fb0 for instance b39f89ed-d391-4030-8013-2f436e3e3950 on hv-cinder-81558 Aug 05 05:17:54.171643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-6a31da3f-c7f3-4484-a5e9-e626e0b732ff req-82e8335c-e3c5-4507-a020-0ba7fa5dd29e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035368 Aug 05 05:17:54.172533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 258/525] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:17:54.189874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:54.190544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:54.197587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.198768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.199481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.200260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.200801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.201292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.237450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:54.238134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:54.245239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.245627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.246055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.246745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.247191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.247610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.272362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:17:54.337723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:54.346127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:54.347692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:54.348858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-66660162-86c2-447d-9a72-ec4362b2e51e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.164212 Aug 05 05:17:54.349684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 268/526] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:54 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:54.355855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a9bf3480-e425-4bda-862f-091b32eb1d1c tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 204 len: 0 microversion: 2.1 time: 0.122308 Aug 05 05:17:54.356825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 259/527] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:17:54 2022] DELETE /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:17:54.366098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:54.366839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:54.373300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.373779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.374202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.374886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:54.375330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:54.375821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:54.513762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:54.525135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3fc0875a-c8b0-45aa-8612-802800c3cbe4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1691 microversion: 2.1 time: 0.163574 Aug 05 05:17:54.525911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 269/528] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:54 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:17:55.131668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:55.132863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:55.143713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:55.144569 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:55.145289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:55.146383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:55.147165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:55.147872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:55.282433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:55.290463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b802c1c7-5fdf-459f-ac8b-5a40c9922bd2 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.166141 Aug 05 05:17:55.291034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 260/529] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:55 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:55.376188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:55.376798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:55.383538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:55.384148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:55.384569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:55.385269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:55.385706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:55.386135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:55.524655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:55.532765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:55.534230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:55.535371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6ed4fd84-e178-44f0-864c-b2919c4c4892 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.165771 Aug 05 05:17:55.535968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 270/530] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:55 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:55.546348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:55.546977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:55.550070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:55.554038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:55.554512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:55.554935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:55.555610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:55.556102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:55.556527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:55.695046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:55.702629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-26a07d28-4bf9-4b5e-9c51-bc9058c03da7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1691 microversion: 2.1 time: 0.160096 Aug 05 05:17:55.703195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 261/531] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:55 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:56.315274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:56.316591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:56.326920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:56.327716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:56.328497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:56.329442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:56.329888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:56.330306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:56.465839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:56.477590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-43b8dac0-4e82-43c8-8864-36e5c3f895e7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.169204 Aug 05 05:17:56.478438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 271/532] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:56 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:56.562607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:56.563655 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:56.570445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:56.570859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:56.571284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:56.572005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:56.572431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:56.572843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:56.703188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:56.715374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:56.717604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:56.718947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-758594b8-83ea-46a8-b70f-2093f1931301 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1407 microversion: 2.20 time: 0.162630 Aug 05 05:17:56.719246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 262/533] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:56 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:56.724172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:56.724783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:56.731122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:56.731626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:56.732084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:56.732760 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:56.733202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:56.733646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:56.737573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:56.868196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:56.876154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-96dbc7d4-9238-4707-95ee-f36ec4350be3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1691 microversion: 2.1 time: 0.155894 Aug 05 05:17:56.876767 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 272/534] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:56 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:57.502387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:57.502899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:57.509400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.509903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.510332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.510989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.511457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.511905 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.654988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:57.663330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-819cae4a-e0b2-47f8-aad3-cafbdda715a4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.167119 Aug 05 05:17:57.663931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 263/535] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:57 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:57.740871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:57.741492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:57.748365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.748841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.749268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.749943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.750386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.750794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.905249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:57.905950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:57.912558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.913109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.913604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.913993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:57.914433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.914942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.915422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.919659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:57.922890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:57.924533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:57.925712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-733f6813-1c03-4747-9b51-b98f5f82d2d5 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1599 microversion: 2.20 time: 0.188861 Aug 05 05:17:57.926280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 273/536] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:17:57 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:17:57.952255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:57.952895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:57.959125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.959613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.960152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:57.960844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:57.961294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:57.961712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:58.062181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-59160409-52b8-4f07-b69e-5f2b66ba43a8 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113993 Aug 05 05:17:58.062779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 274/537] 10.222.0.30 () {60 vars in 1316 bytes} [Fri Aug 5 05:17:57 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:17:58.086226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:58.094117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1657bcfe-1561-4713-b282-dc2757a1f016 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1691 microversion: 2.1 time: 0.192841 Aug 05 05:17:58.094781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 264/538] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:57 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:58.680872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=14 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:17:58.685288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:58.686137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:58.692735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:58.693190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:58.693617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:58.694297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:58.694741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:58.695135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:58.854552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:58.862158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-35c866d4-ee2e-4bb7-9b69-cbfd50ccf966 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.182162 Aug 05 05:17:58.863407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 275/539] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:58 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:59.116023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:59.117244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:59.124416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:59.125132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:59.126258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:59.127203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:59.127755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:59.128303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:59.329869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:17:59.338324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3325d78c-1483-47ca-91ea-ee2eefe21b02 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1691 microversion: 2.1 time: 0.227135 Aug 05 05:17:59.338784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 265/540] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:59 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1691 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:17:59.462894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-45db46f1-9048-4343-af24-2c5776cf7a3a req-22da157d-b450-4f69-b111-92d9f1f0755a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:17:59.472845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-45db46f1-9048-4343-af24-2c5776cf7a3a req-22da157d-b450-4f69-b111-92d9f1f0755a service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:59.473339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-45db46f1-9048-4343-af24-2c5776cf7a3a req-22da157d-b450-4f69-b111-92d9f1f0755a service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:59.473904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-45db46f1-9048-4343-af24-2c5776cf7a3a req-22da157d-b450-4f69-b111-92d9f1f0755a service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:59.487058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-45db46f1-9048-4343-af24-2c5776cf7a3a req-22da157d-b450-4f69-b111-92d9f1f0755a service nova] Creating event network-changed:98cad295-2ec9-44a3-9512-556b38096e67 for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc on hv-cinder-81558 Aug 05 05:17:59.492483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-45db46f1-9048-4343-af24-2c5776cf7a3a req-22da157d-b450-4f69-b111-92d9f1f0755a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033256 Aug 05 05:17:59.493305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 276/541] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:17:59.883018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:17:59.884017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:17:59.891117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:59.891937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:59.892528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:17:59.893604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:17:59.894217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:17:59.894827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:00.047208 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:00.054716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9a9f2bce-d0b2-4794-b4cd-1dd5d9d98a28 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.175538 Aug 05 05:18:00.063912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 266/542] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:17:59 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:00.361440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:00.362234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:00.372356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:00.373243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:00.373890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:00.374750 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:00.375349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:00.376332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:00.413881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:00.414794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:00.415553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:00.416258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'fault' on Instance uuid bed093e9-77c9-43a3-b480-77d26728cb34 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:18:00.469656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:00.477812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-74f8e569-d343-42cd-9fdb-5e8506a760e7 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 200 len: 1336 microversion: 2.1 time: 0.121776 Aug 05 05:18:00.478617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 277/543] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:00 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:01.078148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:01.079029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:01.081499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:01.082207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=10 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:01.088428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:01.088916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:01.089365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:01.090059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:01.090488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:01.090903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:01.277649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:01.285615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e5898418-a67d-4982-808b-389a2ca074bb tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.213635 Aug 05 05:18:01.286150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 267/544] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:01 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:01.503636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:01.504660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: bed093e9-77c9-43a3-b480-77d26728cb34] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:01.514150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-8a0eef3d-d010-42dc-b0e0-952157dff195 req-49a255d8-658d-458c-a272-54594174b3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed093e9-77c9-43a3-b480-77d26728cb34", "name": "network-vif-deleted", "tag": "232fe0eb-f94f-4739-bf4b-435ded0bfd05"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:01.516201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:01.516999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:01.517646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:01.518355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:01.518802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:01.519242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:01.528772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8a0eef3d-d010-42dc-b0e0-952157dff195 req-49a255d8-658d-458c-a272-54594174b3f0 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:01.529168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8a0eef3d-d010-42dc-b0e0-952157dff195 req-49a255d8-658d-458c-a272-54594174b3f0 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:01.529587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8a0eef3d-d010-42dc-b0e0-952157dff195 req-49a255d8-658d-458c-a272-54594174b3f0 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:01.536884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] HTTP exception thrown: Instance bed093e9-77c9-43a3-b480-77d26728cb34 could not be found. Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Request method failure captured: Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 HTTP/1.1 Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KbulsjSmVXWUZbWw2tL7fu3Wi_gaLJoQm4LnvR3EQfPN-z9TY7sqyVojnvPfqOtrgPpHbUoytSLKkl6UtPzp9ebFaWHV_yo1mQCGHCBP-HdqwMabsvj20MTYKRNT4lPg7tiAbBDIXZu1-5X9NDqCdLgeQm8MYhYYosLcYtzbW34EFQ Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:18:01.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b672d5801cb4fdf87d6626f4603e281", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c7c57f5e11a84bf98d474837adbb0ba7 Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance bed093e9-77c9-43a3-b480-77d26728cb34 could not be found. Aug 05 05:18:01.540513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'bed093e9-77c9-43a3-b480-77d26728cb34'} Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed093e9-77c9-43a3-b480-77d26728cb34 could not be found. Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:18:01.541392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed093e9-77c9-43a3-b480-77d26728cb34 could not be found. Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed093e9-77c9-43a3-b480-77d26728cb34 could not be found. Aug 05 05:18:01.542748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:18:01.544318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Returning 404 to user: Instance bed093e9-77c9-43a3-b480-77d26728cb34 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:18:01.544318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d8cede55-a0ff-4d85-aa73-5f7a163307b4 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34" status: 404 len: 111 microversion: 2.1 time: 0.043261 Aug 05 05:18:01.544513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-8a0eef3d-d010-42dc-b0e0-952157dff195 req-49a255d8-658d-458c-a272-54594174b3f0 service nova] Creating event network-vif-deleted:232fe0eb-f94f-4739-bf4b-435ded0bfd05 for instance bed093e9-77c9-43a3-b480-77d26728cb34 on hv-cinder-81558 Aug 05 05:18:01.544621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 278/545] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:01 2022] GET /compute/v2.1/servers/bed093e9-77c9-43a3-b480-77d26728cb34 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:01.546978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-8a0eef3d-d010-42dc-b0e0-952157dff195 req-49a255d8-658d-458c-a272-54594174b3f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039852 Aug 05 05:18:01.549087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ceada1c3-4c9d-47b2-9622-3c470dc78ca8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '.version_select at 0x7fdc9dc14c10>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:01.549397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 268/546] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:01.570649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ceada1c3-4c9d-47b2-9622-3c470dc78ca8 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300815495" status: 202 len: 0 microversion: 2.1 time: 0.025198 Aug 05 05:18:01.571216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 279/547] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Aug 5 05:18:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300815495 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:18:02.309393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:02.310099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:02.317601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:02.318261 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:02.318758 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:02.319757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:02.320207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:02.320763 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:02.459003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:02.466784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d1885caf-81ce-473c-8820-1781d8d5c892 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.162300 Aug 05 05:18:02.467665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 269/548] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:02 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:03.491538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:03.492580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:03.504540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:03.505021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:03.505423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:03.506160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:03.506604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:03.508206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:03.692610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:03.700375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a00a742a-dc1e-47c9-9d40-ed9ff92d1f86 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.215215 Aug 05 05:18:03.700910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 280/549] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:03 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:04.664342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:04.664846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:04.671904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:04.672388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:04.672827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:04.673516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:04.673967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:04.674385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:04.699027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:18:04.721475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:04.722060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:04.729104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:04.729599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:04.730024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:04.730678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:04.731323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:04.731804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:04.780236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-53a53912-f03f-4c1e-869a-2d6aa0b7bc05 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "DELETE /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 204 len: 0 microversion: 2.1 time: 0.119805 Aug 05 05:18:04.781109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 270/550] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:18:04 2022] DELETE /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:18:04.789946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:04.790727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:04.797116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:04.797600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:04.798034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:04.798729 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:04.799181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:04.799601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:04.911050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:04.919124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-12e61401-13d8-408d-871b-6443e15ec8ca tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.201530 Aug 05 05:18:04.919699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 281/551] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:04 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:04.961083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:04.972370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dc72f7e2-f0a8-42a6-98bb-a73ecd5a43c6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1509 microversion: 2.1 time: 0.186917 Aug 05 05:18:04.973187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 271/552] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:04 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:05.297333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-e274bf4a-9d50-4302-b308-1371034c7c92 req-05ec5663-29ed-4f5c-9d30-fa83872739e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f89ed-d391-4030-8013-2f436e3e3950", "name": "network-vif-plugged", "status": "completed", "tag": "0325c509-c7b4-45f1-bcfa-cc99cc230fb0"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:05.307133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e274bf4a-9d50-4302-b308-1371034c7c92 req-05ec5663-29ed-4f5c-9d30-fa83872739e2 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:05.307636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e274bf4a-9d50-4302-b308-1371034c7c92 req-05ec5663-29ed-4f5c-9d30-fa83872739e2 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:05.308069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e274bf4a-9d50-4302-b308-1371034c7c92 req-05ec5663-29ed-4f5c-9d30-fa83872739e2 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:05.319433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-e274bf4a-9d50-4302-b308-1371034c7c92 req-05ec5663-29ed-4f5c-9d30-fa83872739e2 service nova] Creating event network-vif-plugged:0325c509-c7b4-45f1-bcfa-cc99cc230fb0 for instance b39f89ed-d391-4030-8013-2f436e3e3950 on hv-cinder-81558 Aug 05 05:18:05.324313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-e274bf4a-9d50-4302-b308-1371034c7c92 req-05ec5663-29ed-4f5c-9d30-fa83872739e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030590 Aug 05 05:18:05.325114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 282/553] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:05.943843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:05.945056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:05.956336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:05.957218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:05.958086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:05.958772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:05.959216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:05.959641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:06.001899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:06.002605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:06.009211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:06.009699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:06.010157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:06.010859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:06.011315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:06.011735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:06.143015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:06.151010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-39582447-5994-4bfe-b7af-34d91674fe80 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.213636 Aug 05 05:18:06.151588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 272/554] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:05 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:06.170595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:06.178513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-35223105-2e40-4d1d-8540-1b60902ece24 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1509 microversion: 2.1 time: 0.181426 Aug 05 05:18:06.179050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 283/555] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:05 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:07.176195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:07.178759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:07.189597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:07.190365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:07.191119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:07.192440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:07.193094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:07.193498 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:07.206891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:07.207882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:07.215117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:07.215701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:07.216342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:07.216977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:07.217514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:07.217987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:07.419280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:07.428258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1d87637d-94c7-4a26-9350-9f4f30b8d978 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.258362 Aug 05 05:18:07.429007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 273/556] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:07 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:07.431338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:07.439702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1d8d22d6-fe08-4803-9bd1-b1aa9bc4a9c5 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1509 microversion: 2.1 time: 0.236836 Aug 05 05:18:07.440584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 284/557] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:07 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:18:07.862026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-1d0047ed-a200-463d-80a1-3201b92c1662 req-3feaaee4-886d-4da2-95e1-a8dba9a789b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a66383-4727-4bd4-bea6-68c1e9e9f3d0", "name": "network-vif-deleted", "tag": "f49600d8-fdfd-4eae-a883-09ec80b1d6d3"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:07.872229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-1d0047ed-a200-463d-80a1-3201b92c1662 req-3feaaee4-886d-4da2-95e1-a8dba9a789b7 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:07.873355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-1d0047ed-a200-463d-80a1-3201b92c1662 req-3feaaee4-886d-4da2-95e1-a8dba9a789b7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:07.873912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-1d0047ed-a200-463d-80a1-3201b92c1662 req-3feaaee4-886d-4da2-95e1-a8dba9a789b7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:07.885450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-1d0047ed-a200-463d-80a1-3201b92c1662 req-3feaaee4-886d-4da2-95e1-a8dba9a789b7 service nova] Creating event network-vif-deleted:f49600d8-fdfd-4eae-a883-09ec80b1d6d3 for instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 on hv-cinder-81558 Aug 05 05:18:07.890273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-1d0047ed-a200-463d-80a1-3201b92c1662 req-3feaaee4-886d-4da2-95e1-a8dba9a789b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 Aug 05 05:18:07.890877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 274/558] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:08.450060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:08.450661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:08.457297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:08.457822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:08.458236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:08.459119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:08.459568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:08.460007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:08.461565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:08.462246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:08.469614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:08.470566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:08.471440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:08.472309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:08.472955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:08.473384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:08.507258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:08.507736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:08.508205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:08.508634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'fault' on Instance uuid 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:18:08.567351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:08.575076 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2f862206-5835-48ef-971a-f8a089e6f283 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 200 len: 1312 microversion: 2.1 time: 0.118351 Aug 05 05:18:08.575633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 275/559] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:08 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:08.615250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:08.623851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c4c61ac2-a15a-4ced-99e6-b7908ef81c53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1364 microversion: 2.1 time: 0.177667 Aug 05 05:18:08.624386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 285/560] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:08 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:09.596814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:09.597402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: 81a66383-4727-4bd4-bea6-68c1e9e9f3d0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:09.604028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.604509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.605074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.605767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.606248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.606625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.623102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] HTTP exception thrown: Instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 could not be found. Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Request method failure captured: Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 HTTP/1.1 Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KbulsjSmVXWUZbWw2tL7fu3Wi_gaLJoQm4LnvR3EQfPN-z9TY7sqyVojnvPfqOtrgPpHbUoytSLKkl6UtPzp9ebFaWHV_yo1mQCGHCBP-HdqwMabsvj20MTYKRNT4lPg7tiAbBDIXZu1-5X9NDqCdLgeQm8MYhYYosLcYtzbW34EFQ Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:18:09.624776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b672d5801cb4fdf87d6626f4603e281", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: c7c57f5e11a84bf98d474837adbb0ba7 Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 could not be found. Aug 05 05:18:09.626386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '81a66383-4727-4bd4-bea6-68c1e9e9f3d0'} Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 could not be found. Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:18:09.627224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 could not be found. Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 could not be found. Aug 05 05:18:09.628645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:09.629915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Returning 404 to user: Instance 81a66383-4727-4bd4-bea6-68c1e9e9f3d0 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:18:09.629915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bd1e1f5a-6277-4b8b-88a4-76d146a0d7d3 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0" status: 404 len: 111 microversion: 2.1 time: 0.033876 Aug 05 05:18:09.629915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 276/561] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:09 2022] GET /compute/v2.1/servers/81a66383-4727-4bd4-bea6-68c1e9e9f3d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:09.634865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:09.635704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:09.642446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.643151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.643745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.644732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.645331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.645932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.647091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:09.648065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:09.656517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.658260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.658848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.659741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.660510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.661038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.672819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:18:09.753004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3bf14cd1-ed93-4aa3-b184-c71f33ba5194 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 204 len: 0 microversion: 2.1 time: 0.121777 Aug 05 05:18:09.754615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 286/562] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:18:09 2022] DELETE /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 05:18:09.762952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:09.763646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:09.769745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.770256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.770685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.771371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.772100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.772529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.794915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:09.802513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c4b0654a-c8d6-43d0-8878-21549ffbe3b7 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1549 microversion: 2.1 time: 0.161149 Aug 05 05:18:09.803147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 277/563] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:09 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:09.822558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:09.823045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:09.829044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.829528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.829954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.830639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:09.831089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:09.831504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:09.922922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ecbe4e54-4b47-4551-9669-db4c4f10190c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104151 Aug 05 05:18:09.923525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 278/564] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:18:09 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:18:09.945086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:09.953200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8cd5beb6-0724-4edc-9da2-da6fc8528cdc tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.194483 Aug 05 05:18:09.953836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 287/565] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:09 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:10.850627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-a9d8cfc3-81d0-491d-8732-896aa5147003 req-0698b315-5e98-4913-ac50-474c1d97f674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f89ed-d391-4030-8013-2f436e3e3950", "tag": "0325c509-c7b4-45f1-bcfa-cc99cc230fb0"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:10.860397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-a9d8cfc3-81d0-491d-8732-896aa5147003 req-0698b315-5e98-4913-ac50-474c1d97f674 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:10.860874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-a9d8cfc3-81d0-491d-8732-896aa5147003 req-0698b315-5e98-4913-ac50-474c1d97f674 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:10.861293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-a9d8cfc3-81d0-491d-8732-896aa5147003 req-0698b315-5e98-4913-ac50-474c1d97f674 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:10.872633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-a9d8cfc3-81d0-491d-8732-896aa5147003 req-0698b315-5e98-4913-ac50-474c1d97f674 service nova] Creating event network-changed:0325c509-c7b4-45f1-bcfa-cc99cc230fb0 for instance b39f89ed-d391-4030-8013-2f436e3e3950 on hv-cinder-81558 Aug 05 05:18:10.877626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-a9d8cfc3-81d0-491d-8732-896aa5147003 req-0698b315-5e98-4913-ac50-474c1d97f674 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Aug 05 05:18:10.878227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 279/566] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:10.974565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:10.975182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:10.982165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:10.982640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:10.983067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:10.983751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:10.984227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:10.984644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:11.121771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:11.129540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-63e48af2-4277-468a-9ac3-f0a6ad1d56d6 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.158957 Aug 05 05:18:11.130438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 288/567] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:10 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:12.152329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:12.153046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:12.159561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:12.160150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:12.160642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:12.161410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:12.162442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:12.162856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:12.292585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:12.300337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dee41cd0-4230-4e49-b7db-7c2d1e2a5aca tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.153132 Aug 05 05:18:12.300892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 280/568] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:12 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:13.321346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:13.321952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:13.329401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:13.330467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:13.330467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:13.331043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:13.331492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:13.331952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:13.557040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:13.564870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f62278b5-26f9-4e23-875c-25c14b1af18a tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1520 microversion: 2.1 time: 0.247430 Aug 05 05:18:13.565453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 289/569] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:13 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:14.090723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-8ca2596a-3819-44a6-b9f2-b647c945f5cd req-cc33d7d9-9f74-4fd6-81d2-6aca8a56f6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff6e938-a58e-4bba-8294-f82b51bc8780", "name": "network-vif-deleted", "tag": "698c4ba3-9bf4-4e10-8b7a-e178c5935a51"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:14.101376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8ca2596a-3819-44a6-b9f2-b647c945f5cd req-cc33d7d9-9f74-4fd6-81d2-6aca8a56f6e3 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:14.101849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8ca2596a-3819-44a6-b9f2-b647c945f5cd req-cc33d7d9-9f74-4fd6-81d2-6aca8a56f6e3 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:14.102268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8ca2596a-3819-44a6-b9f2-b647c945f5cd req-cc33d7d9-9f74-4fd6-81d2-6aca8a56f6e3 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:14.113191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-8ca2596a-3819-44a6-b9f2-b647c945f5cd req-cc33d7d9-9f74-4fd6-81d2-6aca8a56f6e3 service nova] Creating event network-vif-deleted:698c4ba3-9bf4-4e10-8b7a-e178c5935a51 for instance aff6e938-a58e-4bba-8294-f82b51bc8780 on hv-cinder-81558 Aug 05 05:18:14.118599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-8ca2596a-3819-44a6-b9f2-b647c945f5cd req-cc33d7d9-9f74-4fd6-81d2-6aca8a56f6e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Aug 05 05:18:14.119660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 281/570] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:14.584654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:14.585294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:14.591751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:14.592332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:14.592712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:14.593393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:14.593836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:14.594273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:14.598370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:14.629038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:14.629439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:14.629872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:14.630315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lazy-loading 'fault' on Instance uuid aff6e938-a58e-4bba-8294-f82b51bc8780 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:18:14.672786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c57f5e11a84bf98d474837adbb0ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b672d5801cb4fdf87d6626f4603e281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:14.680694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2c6d1096-8a16-40ba-9eaa-1acd43d3d367 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 200 len: 1310 microversion: 2.1 time: 0.099971 Aug 05 05:18:14.681277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 290/571] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:14 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:15.706120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:15.707039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] [instance: aff6e938-a58e-4bba-8294-f82b51bc8780] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:15.714222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:15.714704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:15.715132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:15.715819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:15.716292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:15.716707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:15.730219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] HTTP exception thrown: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 could not be found. Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Request method failure captured: Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 HTTP/1.1 Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KbulsjSmVXWUZbWw2tL7fu3Wi_gaLJoQm4LnvR3EQfPN-z9TY7sqyVojnvPfqOtrgPpHbUoytSLKkl6UtPzp9ebFaWHV_yo1mQCGHCBP-HdqwMabsvj20MTYKRNT4lPg7tiAbBDIXZu1-5X9NDqCdLgeQm8MYhYYosLcYtzbW34EFQ Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:18:15.731826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b672d5801cb4fdf87d6626f4603e281", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b672d5801cb4fdf87d6626f4603e281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 4b672d5801cb4fdf87d6626f4603e281 Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-502026605 Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: c7c57f5e11a84bf98d474837adbb0ba7 Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-502026605-project Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 could not be found. Aug 05 05:18:15.733243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'aff6e938-a58e-4bba-8294-f82b51bc8780'} Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 could not be found. Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:18:15.733996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 could not be found. Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 could not be found. Aug 05 05:18:15.735447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:15.736855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] Returning 404 to user: Instance aff6e938-a58e-4bba-8294-f82b51bc8780 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:18:15.736855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-68c0f37c-02a0-4d86-a811-1a13ddd8a595 tempest-ServerRescueNegativeTestJSON-502026605 tempest-ServerRescueNegativeTestJSON-502026605-project] 10.222.0.30 "GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780" status: 404 len: 111 microversion: 2.1 time: 0.033597 Aug 05 05:18:15.736855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 282/572] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:15 2022] GET /compute/v2.1/servers/aff6e938-a58e-4bba-8294-f82b51bc8780 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:24.315350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6f4632c1-6ccf-4f8f-8da7-1b407a33fe1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: .version_select at 0x7fdc9dcafee0>, body: {"keypair": {"name": "tempest-keypair-986966782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWQ6jaX/QXkvB0jWkilYoa9dR2hXVIIrhhGvc0hlsQOINd+UPuEinDnXkjNG5avEZDYw43fkvcrmjEpXmCqwtp0Xohbj3HQd63PxewYbBxJM7xMCGPlOf1JRvrdYtDLRg=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:24.320883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:24.340123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-6f4632c1-6ccf-4f8f-8da7-1b407a33fe1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:18:24.344928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-6f4632c1-6ccf-4f8f-8da7-1b407a33fe1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:18:24.370120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6f4632c1-6ccf-4f8f-8da7-1b407a33fe1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212569 Aug 05 05:18:24.371076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 291/573] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:18:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:25.602496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-262184329", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dfb9760-7f7c-4d72-90dd-3ced7593c930"}], "security_groups": [{"name": "tempest-securitygroup--1776257348"}], "key_name": "tempest-keypair-986966782", "user_data": "}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:25.611646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:25.718658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] validate_networks() for [('8dfb9760-7f7c-4d72-90dd-3ced7593c930', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:18:25.724029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:26.147394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:18:26.148042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:18:26.148719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:18:26.149091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:18:26.149650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:18:26.158597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:26.159142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:26.159636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:26.160440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:26.160911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:26.161322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:26.178836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:18:26.183350 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:18:26.195198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:18:26.197448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:18:26.260391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f3c62010-1386-4036-ba5c-6811b36e48fd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662564 Aug 05 05:18:26.261229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 283/574] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:18:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:18:26.273304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8756c0d8-a839-441f-aaa1-2a67b0c092c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:26.274090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8756c0d8-a839-441f-aaa1-2a67b0c092c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:26.276197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:26.344699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8756c0d8-a839-441f-aaa1-2a67b0c092c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:26.353352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8756c0d8-a839-441f-aaa1-2a67b0c092c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1240 microversion: 2.1 time: 0.084445 Aug 05 05:18:26.354649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 292/575] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:18:27.375334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:27.376121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:27.383629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:27.384175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:27.384613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:27.385455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:27.385917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:27.386510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:27.457058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:27.466814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bf3a8b39-27da-4eaf-920c-6fb2f20e9c8d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1292 microversion: 2.1 time: 0.095947 Aug 05 05:18:27.467386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 284/576] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:28.489516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:28.490790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:28.498860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:28.499649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:28.500293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:28.501150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:28.502404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:28.503002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:28.764694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:28.772864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ffd25249-cae7-48e6-bc24-93167ce8c9f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.288102 Aug 05 05:18:28.773393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 293/577] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:29.100756 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-0f392397-763a-4ad4-b6ac-660b6f8cb0a4 req-1fd07162-5315-4c74-bf7b-d44d076f81fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e365c429-240d-4397-a002-eae5c51453cf", "tag": "b74342d7-9a40-4a69-97ff-c95f0cd0f890"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:29.110846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f392397-763a-4ad4-b6ac-660b6f8cb0a4 req-1fd07162-5315-4c74-bf7b-d44d076f81fd service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:29.111337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f392397-763a-4ad4-b6ac-660b6f8cb0a4 req-1fd07162-5315-4c74-bf7b-d44d076f81fd service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:29.111754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f392397-763a-4ad4-b6ac-660b6f8cb0a4 req-1fd07162-5315-4c74-bf7b-d44d076f81fd service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:29.125624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-0f392397-763a-4ad4-b6ac-660b6f8cb0a4 req-1fd07162-5315-4c74-bf7b-d44d076f81fd service nova] Creating event network-changed:b74342d7-9a40-4a69-97ff-c95f0cd0f890 for instance e365c429-240d-4397-a002-eae5c51453cf on hv-cinder-81558 Aug 05 05:18:29.130729 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-0f392397-763a-4ad4-b6ac-660b6f8cb0a4 req-1fd07162-5315-4c74-bf7b-d44d076f81fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033829 Aug 05 05:18:29.131591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 285/578] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:29.802960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:29.803503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:29.810381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:29.810858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:29.811281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:29.812004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:29.812446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:29.812862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:29.962179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:29.973383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1cb1d0dc-e7d2-40c7-bd60-b467727be778 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.177063 Aug 05 05:18:29.974222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 294/579] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:30.996920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:30.998843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:31.007469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:31.008028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:31.008454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:31.009166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:31.009618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:31.010060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:31.143621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:31.151617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-715ea549-385e-457d-9e89-d06730eef73a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.160954 Aug 05 05:18:31.152230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 286/580] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:31.511485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-366133737"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:31.512435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:31.523258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:31.523740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:31.524201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:31.524885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:31.525328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:31.525742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:31.652761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.network.security_group_api [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Removing security group bd53615b-eb97-430d-be54-37d56f6e31b0 from port 38b31332-3a4e-48c6-818c-271880cf2489 Aug 05 05:18:31.967869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-70121302-c5fb-4bc1-9be2-eee24af5a91f tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/action" status: 202 len: 0 microversion: 2.1 time: 0.463093 Aug 05 05:18:31.968843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 295/581] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:18:31 2022] POST /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:18:31.976319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-ebef5028-0d07-47f6-9379-2566286bdf6d req-22ca0762-d3ca-4a9a-84cf-13d7e0f510a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:31.985893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ebef5028-0d07-47f6-9379-2566286bdf6d req-22ca0762-d3ca-4a9a-84cf-13d7e0f510a1 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:31.986446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ebef5028-0d07-47f6-9379-2566286bdf6d req-22ca0762-d3ca-4a9a-84cf-13d7e0f510a1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:31.986931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ebef5028-0d07-47f6-9379-2566286bdf6d req-22ca0762-d3ca-4a9a-84cf-13d7e0f510a1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:31.998849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-ebef5028-0d07-47f6-9379-2566286bdf6d req-22ca0762-d3ca-4a9a-84cf-13d7e0f510a1 service nova] Creating event network-changed:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:18:32.004922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-ebef5028-0d07-47f6-9379-2566286bdf6d req-22ca0762-d3ca-4a9a-84cf-13d7e0f510a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032787 Aug 05 05:18:32.006004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 287/582] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:32.174127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:32.175332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:32.183712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:32.184493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:32.185346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:32.186403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:32.187168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:32.187932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:32.416617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:32.424827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4f836b0f-6c65-476d-a9de-a87e25de6c70 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.255556 Aug 05 05:18:32.425386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 296/583] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:33.021660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:33.022184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-375512d3-5175-4528-8d82-a09fc403523f req-6f808a33-9083-4ac2-897b-a8273fd23525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:33.022543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:33.028752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.029304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.029809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.030657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.031185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.031540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-375512d3-5175-4528-8d82-a09fc403523f req-6f808a33-9083-4ac2-897b-a8273fd23525 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.031658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.032095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-375512d3-5175-4528-8d82-a09fc403523f req-6f808a33-9083-4ac2-897b-a8273fd23525 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.032515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-375512d3-5175-4528-8d82-a09fc403523f req-6f808a33-9083-4ac2-897b-a8273fd23525 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.044171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-375512d3-5175-4528-8d82-a09fc403523f req-6f808a33-9083-4ac2-897b-a8273fd23525 service nova] Creating event network-changed:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:18:33.049318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-375512d3-5175-4528-8d82-a09fc403523f req-6f808a33-9083-4ac2-897b-a8273fd23525 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 Aug 05 05:18:33.050240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 297/584] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:33.116391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lazy-loading 'services' on Instance uuid e4d72c26-3c71-4046-957d-57f1e4b2b18b {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:18:33.192647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-61036e32-7e51-4a9f-8311-6d277cb0a931 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments/a297955d-7276-44a6-b820-34edb48a3f49" status: 202 len: 0 microversion: 2.1 time: 0.175789 Aug 05 05:18:33.194035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 288/585] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:18:33 2022] DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments/a297955d-7276-44a6-b820-34edb48a3f49 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:18:33.203042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:33.205318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:33.212190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.212867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.213449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.214444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.215117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.215672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.246787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-080c7ad3-bbd3-4195-94d9-cd33a90352ff tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Aug 05 05:18:33.247603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 298/586] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:18:33 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:33.446554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:33.447437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:33.454491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.454987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.455536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.456260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:33.456796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:33.457111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:33.593229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:33.601195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-27ee50a4-f23e-4c83-b0b2-77ca2d962188 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.158977 Aug 05 05:18:33.601815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 289/587] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:34.260189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:34.262736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:34.271996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:34.272561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:34.273022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:34.273723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:34.274168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:34.275526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:34.306688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cd72c69e-10cb-4975-a610-fbb40119fce0 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051297 Aug 05 05:18:34.307483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 299/588] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:18:34 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:18:34.317983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:34.318698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:34.325197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:34.325684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:34.326107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:34.326796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:34.327236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:34.327656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:34.405241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] HTTP exception thrown: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b is not attached to volume a297955d-7276-44a6-b820-34edb48a3f49 Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Request method failure captured: Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments/a297955d-7276-44a6-b820-34edb48a3f49 HTTP/1.1 Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KeXdFWHY-Otxe1GbpKCnymGbl_obHNFS6LWRicsEJnlVtyyST7C8K9FAfN2Hu7rlXMxyECKHm8-_ahrkpOkf1svVW4J14w0WD4qoPZWkrSlBQtENzjKPUvn8uiyimNS1lyDduqB7HQNf6IH_tS4FNse6SmnRZ0d9StkGwv6TXe05RA Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 28b64940359146368434f38f443b5afd Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-TestMinimumBasicScenario-37562144 Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:18:34.407599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28b64940359146368434f38f443b5afd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28b64940359146368434f38f443b5afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28b64940359146368434f38f443b5afd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28b64940359146368434f38f443b5afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-TestMinimumBasicScenario-37562144 Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 28b64940359146368434f38f443b5afd Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-TestMinimumBasicScenario-37562144 Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-TestMinimumBasicScenario-37562144-project Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 65d6d5c6915543dfac67beef1ddaf8b3 Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-TestMinimumBasicScenario-37562144-project Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:18:34.409169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b is not attached to volume a297955d-7276-44a6-b820-34edb48a3f49 Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'server_id': 'e4d72c26-3c71-4046-957d-57f1e4b2b18b', 'id': 'a297955d-7276-44a6-b820-34edb48a3f49'} Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a297955d-7276-44a6-b820-34edb48a3f49. Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:18:34.410051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b is not attached to volume a297955d-7276-44a6-b820-34edb48a3f49 Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b is not attached to volume a297955d-7276-44a6-b820-34edb48a3f49 Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:34.411284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Returning 404 to user: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b is not attached to volume a297955d-7276-44a6-b820-34edb48a3f49 {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:18:34.412624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-55b7fda1-6b6a-43a7-b977-99965d0ff6ad tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments/a297955d-7276-44a6-b820-34edb48a3f49" status: 404 len: 154 microversion: 2.1 time: 0.095215 Aug 05 05:18:34.412624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 290/589] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:18:34 2022] DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b/os-volume_attachments/a297955d-7276-44a6-b820-34edb48a3f49 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:34.625644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:34.626544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:34.636641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:34.637438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:34.638153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:34.639279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:34.640094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:34.640808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:34.777694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:34.787030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c54b48c5-8500-4229-9906-88a5b357c58f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.167704 Aug 05 05:18:34.787600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 300/590] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:35.386883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-09ca6ce1-3134-4d69-8a9a-1f1e5e7b1996 req-72f7274c-d0cc-446a-a6b3-a0bd568520f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e365c429-240d-4397-a002-eae5c51453cf", "name": "network-vif-plugged", "status": "completed", "tag": "b74342d7-9a40-4a69-97ff-c95f0cd0f890"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:35.397592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-09ca6ce1-3134-4d69-8a9a-1f1e5e7b1996 req-72f7274c-d0cc-446a-a6b3-a0bd568520f6 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.398646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-09ca6ce1-3134-4d69-8a9a-1f1e5e7b1996 req-72f7274c-d0cc-446a-a6b3-a0bd568520f6 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.399080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-09ca6ce1-3134-4d69-8a9a-1f1e5e7b1996 req-72f7274c-d0cc-446a-a6b3-a0bd568520f6 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.410980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-09ca6ce1-3134-4d69-8a9a-1f1e5e7b1996 req-72f7274c-d0cc-446a-a6b3-a0bd568520f6 service nova] Creating event network-vif-plugged:b74342d7-9a40-4a69-97ff-c95f0cd0f890 for instance e365c429-240d-4397-a002-eae5c51453cf on hv-cinder-81558 Aug 05 05:18:35.416284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-09ca6ce1-3134-4d69-8a9a-1f1e5e7b1996 req-72f7274c-d0cc-446a-a6b3-a0bd568520f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033241 Aug 05 05:18:35.416922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 291/591] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:35.550407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:35.550930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:35.557334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.557997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.558420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.559101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.559707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.560146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.588900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:18:35.670651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-11b58a41-4cc4-472b-ba3d-6a531cc6405d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 204 len: 0 microversion: 2.1 time: 0.123669 Aug 05 05:18:35.671485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 301/592] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:18:35 2022] DELETE /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 05:18:35.680437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:35.681122 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:35.687530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.688084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.688508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.689448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.690023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.690521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.829437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:35.837719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-09ea860f-a31c-4309-9e25-40a5a8e79b9d tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1555 microversion: 2.1 time: 0.161459 Aug 05 05:18:35.838356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 292/593] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:35 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:35.843241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:35.843930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:35.849745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.850291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.850787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.851564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.852100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.852545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.873765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:35.874346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:35.880227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.880705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.881182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.881860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:35.882299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:35.882744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:35.905587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f87eeb32-57de-405a-8251-149b76cc3e82 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/ips" status: 200 len: 151 microversion: 2.20 time: 0.143767 Aug 05 05:18:35.906153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 302/594] 10.222.0.30 () {60 vars in 1289 bytes} [Fri Aug 5 05:18:35 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/ips => generated 151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 05:18:35.983387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:35.991270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-330f0167-e797-4ac7-abaf-b4d9d8a9abd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.151688 Aug 05 05:18:35.992100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 293/595] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:36.860686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:36.861509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:36.864625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:36.871034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:36.871514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:36.871980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:36.872665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:36.873109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:36.873531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:37.009463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:37.012469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:37.013085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:37.015088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:37.015797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:37.018765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-136036ab-bcfe-4cce-965f-b635d7b251f2 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1555 microversion: 2.1 time: 0.163063 Aug 05 05:18:37.019410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 303/596] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:36 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:37.022524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:37.023008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:37.023439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:37.024169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:37.024615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:37.025027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:37.156955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:37.165600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-36cc309b-55e2-43b2-8fb1-85b474359f0b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.157047 Aug 05 05:18:37.166172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 294/597] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:38.039854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:38.040472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:38.047316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.047793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.048250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.048943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.049394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.049819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.188117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:38.188953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:38.194170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:38.196625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.197334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.198176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.199151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.199849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.200650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.202168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e75d7789-16dd-4bde-b9ff-c109ff4c577b tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1555 microversion: 2.1 time: 0.166643 Aug 05 05:18:38.202945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 304/598] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:38 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:38.339443 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:38.347284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-74991b1d-25f6-4988-abe7-6ad98d24c39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1366 microversion: 2.1 time: 0.164611 Aug 05 05:18:38.347882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 295/599] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:38.403970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:38.404507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:38.410630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.411123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.412057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.412628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.413080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.413496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.436424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lazy-loading 'flavor' on Instance uuid 67fa71ba-15b4-41ed-86e9-b0df6317b0cc {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:18:38.624777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-557617e9-4d30-44d0-b3bb-75803e5cb004 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/action" status: 202 len: 0 microversion: 2.20 time: 0.224725 Aug 05 05:18:38.625379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 305/600] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Aug 5 05:18:38 2022] POST /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:18:38.633756 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:38.634358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:38.640566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.641049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.641472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.642157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.642766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.643178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.819075 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:38.827294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:38.828814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:38.829982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f737c602-4736-4026-957e-aee09b6dee4e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.200263 Aug 05 05:18:38.830541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 296/601] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:38 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:18:38.916531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-5fc03651-e73c-4f22-8cfc-1c823f9d4ec8 req-5c104ffd-6b3a-4aa3-9f25-5240e317c404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d72c26-3c71-4046-957d-57f1e4b2b18b", "name": "network-vif-deleted", "tag": "38b31332-3a4e-48c6-818c-271880cf2489"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:38.926430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5fc03651-e73c-4f22-8cfc-1c823f9d4ec8 req-5c104ffd-6b3a-4aa3-9f25-5240e317c404 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:38.926900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5fc03651-e73c-4f22-8cfc-1c823f9d4ec8 req-5c104ffd-6b3a-4aa3-9f25-5240e317c404 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:38.927322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5fc03651-e73c-4f22-8cfc-1c823f9d4ec8 req-5c104ffd-6b3a-4aa3-9f25-5240e317c404 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:38.938349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-5fc03651-e73c-4f22-8cfc-1c823f9d4ec8 req-5c104ffd-6b3a-4aa3-9f25-5240e317c404 service nova] Creating event network-vif-deleted:38b31332-3a4e-48c6-818c-271880cf2489 for instance e4d72c26-3c71-4046-957d-57f1e4b2b18b on hv-cinder-81558 Aug 05 05:18:38.943214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-5fc03651-e73c-4f22-8cfc-1c823f9d4ec8 req-5c104ffd-6b3a-4aa3-9f25-5240e317c404 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031230 Aug 05 05:18:38.943816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 306/602] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:39.226786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:39.227374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:39.234056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.234561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.234997 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.235685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.236174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.236590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.300240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d6d5c6915543dfac67beef1ddaf8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b64940359146368434f38f443b5afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:39.308404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-666f8709-9767-4b06-8880-f23d56abd292 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 200 len: 1513 microversion: 2.1 time: 0.085395 Aug 05 05:18:39.308951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 297/603] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:39 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 1513 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:39.369426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:39.370122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:39.377851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.378365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.378737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.379463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.380003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.380421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.513665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:39.517273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:39.521868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ad1d7b66-b51e-4abc-8b03-8de2d99ec8ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1555 microversion: 2.1 time: 0.157475 Aug 05 05:18:39.522423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 307/604] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:18:39.542850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:39.543445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:39.549879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.550368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.550791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.551481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.551960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.552379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.639694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9dcd4f4-7bac-4617-93a9-608964d92225 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100768 Aug 05 05:18:39.640323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 298/605] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:18:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:39.855117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:39.855946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:39.863459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.863972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.864474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:39.865172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:39.865617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:39.866031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:40.009316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:40.019188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:40.020692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:40.021850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2a93ab25-1e27-4d97-870f-a93dabfa3fc7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.171856 Aug 05 05:18:40.022410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 308/606] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:39 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:40.330389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:40.330974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] [instance: e4d72c26-3c71-4046-957d-57f1e4b2b18b] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:40.337859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:40.338603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:40.339029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:40.339779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:40.340417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:40.340898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:40.355785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] HTTP exception thrown: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b could not be found. Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Request method failure captured: Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b HTTP/1.1 Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KeXdFWHY-Otxe1GbpKCnymGbl_obHNFS6LWRicsEJnlVtyyST7C8K9FAfN2Hu7rlXMxyECKHm8-_ahrkpOkf1svVW4J14w0WD4qoPZWkrSlBQtENzjKPUvn8uiyimNS1lyDduqB7HQNf6IH_tS4FNse6SmnRZ0d9StkGwv6TXe05RA Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 28b64940359146368434f38f443b5afd Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-TestMinimumBasicScenario-37562144 Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:18:40.357505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28b64940359146368434f38f443b5afd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28b64940359146368434f38f443b5afd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28b64940359146368434f38f443b5afd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28b64940359146368434f38f443b5afd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-TestMinimumBasicScenario-37562144 Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 28b64940359146368434f38f443b5afd Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-TestMinimumBasicScenario-37562144 Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-TestMinimumBasicScenario-37562144-project Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 65d6d5c6915543dfac67beef1ddaf8b3 Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-TestMinimumBasicScenario-37562144-project Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b could not be found. Aug 05 05:18:40.358891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'e4d72c26-3c71-4046-957d-57f1e4b2b18b'} Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b could not be found. Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:18:40.359595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b could not be found. Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b could not be found. Aug 05 05:18:40.361308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:18:40.362330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Returning 404 to user: Instance e4d72c26-3c71-4046-957d-57f1e4b2b18b could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:18:40.362330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-862509c8-1684-4dce-b6bf-0497b9728f82 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b" status: 404 len: 111 microversion: 2.1 time: 0.033122 Aug 05 05:18:40.362330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 299/607] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:18:40 2022] GET /compute/v2.1/servers/e4d72c26-3c71-4046-957d-57f1e4b2b18b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:18:40.368203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-95d4b169-d99c-4615-a7d8-7942d5e6e704 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] Calling method '.version_select at 0x7fdc9da1e790>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:40.389407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-95d4b169-d99c-4615-a7d8-7942d5e6e704 tempest-TestMinimumBasicScenario-37562144 tempest-TestMinimumBasicScenario-37562144-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1901620686" status: 202 len: 0 microversion: 2.1 time: 0.024889 Aug 05 05:18:40.390046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 309/608] 10.222.0.30 () {58 vars in 1272 bytes} [Fri Aug 5 05:18:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1901620686 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:18:40.915819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-d2f9eebb-3388-439b-bcfa-7d57721c5f60 req-80aeecfa-8f45-4d08-99bb-f9fbff4f4f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e365c429-240d-4397-a002-eae5c51453cf", "tag": "b74342d7-9a40-4a69-97ff-c95f0cd0f890"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:40.925975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d2f9eebb-3388-439b-bcfa-7d57721c5f60 req-80aeecfa-8f45-4d08-99bb-f9fbff4f4f49 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:40.926670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d2f9eebb-3388-439b-bcfa-7d57721c5f60 req-80aeecfa-8f45-4d08-99bb-f9fbff4f4f49 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:40.927166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d2f9eebb-3388-439b-bcfa-7d57721c5f60 req-80aeecfa-8f45-4d08-99bb-f9fbff4f4f49 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:40.939542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-d2f9eebb-3388-439b-bcfa-7d57721c5f60 req-80aeecfa-8f45-4d08-99bb-f9fbff4f4f49 service nova] Creating event network-changed:b74342d7-9a40-4a69-97ff-c95f0cd0f890 for instance e365c429-240d-4397-a002-eae5c51453cf on hv-cinder-81558 Aug 05 05:18:40.944683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-d2f9eebb-3388-439b-bcfa-7d57721c5f60 req-80aeecfa-8f45-4d08-99bb-f9fbff4f4f49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101919 Aug 05 05:18:40.945286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 300/609] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:41.046918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:41.047663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:41.063516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:41.063516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:41.063516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:41.063516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:41.064052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:41.064052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:41.312647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:41.324385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:41.327690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:41.330073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3d5f2097-9c0e-4516-b4e5-b853be270cec tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.288833 Aug 05 05:18:41.330927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 310/610] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:41 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:42.354541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:42.355323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:42.362654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:42.363251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:42.363690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:42.364434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:42.365003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:42.365417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:42.501546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:42.511556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:42.513374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:42.514735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3c0bb361-039a-4372-b659-119422a1ca6d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.165082 Aug 05 05:18:42.515409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 301/611] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:42 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:43.538350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:43.538938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:43.545914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:43.546339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:43.546775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:43.547473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:43.547943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:43.548356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:43.699421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:43.707949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:43.709584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:43.710736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-af8bb98f-4ac3-40b0-8c3a-ff17d6460beb tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.176717 Aug 05 05:18:43.711296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 311/612] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:43 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:44.736352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:44.736950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:44.743898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:44.744384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:44.744811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:44.745502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:44.745983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:44.746515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:45.001192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:45.009684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:45.011257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:45.012544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-50bff240-cfee-4dca-be6f-3a3f9d1e7da2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.280274 Aug 05 05:18:45.013374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 302/613] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:44 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:46.036147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:46.037237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:46.044200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:46.045004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:46.045692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:46.046606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:46.047136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:46.047808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:46.460586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:46.469144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:46.470626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:46.471803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-829fc9de-204c-4fcf-b21c-d182ed21ef0e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.439840 Aug 05 05:18:46.472343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 312/614] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:46 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:46.797455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:46.797932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:46.804133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:46.804688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:46.805187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:46.805963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:46.806480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:46.806963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:46.811067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:46.831313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-28d91607-5f3d-4f20-a74a-8b1d54b68055 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/ips" status: 200 len: 144 microversion: 2.1 time: 0.151967 Aug 05 05:18:46.832033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 303/615] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:18:46 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/ips => generated 144 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:47.496360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:47.497011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:47.503293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:47.503779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:47.504216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:47.504897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:47.505343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:47.505752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:47.640635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:47.649690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:47.651425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:47.652901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3609bbf2-ebb8-4755-90d8-bf8a7544a918 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.161924 Aug 05 05:18:47.653546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 313/616] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:47 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:48.239109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "973a697e-79b8-47e2-854c-e20cbec24833"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:48.242688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:48.250135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:48.250873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:48.251273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:48.252049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:48.252538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:48.252971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:48.551647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-07f931c2-a12b-4cd3-bcaf-7cefa76f96d4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316656 Aug 05 05:18:48.552506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 304/617] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:18:48 2022] POST /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:48.676524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:48.677127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:48.684719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:48.685218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:48.685648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:48.686360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:48.686809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:48.687228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:48.822476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:48.831380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:48.832938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:48.834123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-afcd0194-a8cf-438b-86ba-b0d86d5d1248 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.161617 Aug 05 05:18:48.834685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 314/618] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:48 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:49.869753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:49.870783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:49.878826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:49.879312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:49.879744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:49.880461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:49.880907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:49.881325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:50.025199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:50.033669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:50.035149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:50.036696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-27058412-0e78-4580-8600-ab43e2a362dd tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.174074 Aug 05 05:18:50.037275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 305/619] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:49 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:51.062014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:51.062856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:51.071174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:51.071824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:51.072443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:51.073351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:51.073944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:51.074501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:51.211059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:51.219482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:51.221028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:51.222190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9a450e29-21e8-4933-aa1e-569039613898 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.165675 Aug 05 05:18:51.222754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 315/620] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:51 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:52.249313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:52.249920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:52.256808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:52.257288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:52.257709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:52.258392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:52.258829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:52.259242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:52.394485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:52.406393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:52.407919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:52.409084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-807d63a2-7e6a-4376-8587-f68d38268e1e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.166309 Aug 05 05:18:52.409639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 306/621] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:52 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:53.436859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:53.437828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:53.449100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:53.449903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:53.450617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:53.451861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:53.452339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:53.452761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:53.585809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:53.596173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:53.597673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:53.598831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fe3dbffb-891e-40e6-9ce4-a8a9dad6cc74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.168563 Aug 05 05:18:53.599399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 316/622] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:53 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:54.626585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:54.627417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:54.638339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:54.639134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:54.639852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:54.640986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:54.641775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:54.642481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:54.780839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:54.789233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:54.790730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:54.791932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4a9f6a9f-796a-4f23-8519-04253abaa626 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.172363 Aug 05 05:18:54.792494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 307/623] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:54 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:55.815149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:55.815795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:55.818177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:55.823646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:55.824154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:55.824588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:55.825275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:55.825718 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:55.826132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:55.969140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:55.981347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:55.983938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:55.985761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8ecc463c-9e45-4054-a5b0-c7228a44f462 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.174388 Aug 05 05:18:55.986544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 317/624] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:55 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:56.145140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:56.148773 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:56.152380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:18:56.158607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:56.159081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:56.159484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:56.160206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:56.160647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:56.161057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:56.197123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-89d58d3f-258d-49b9-9c35-dffeaf1db070 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058380 Aug 05 05:18:56.197906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 308/625] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:18:56 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:56.210542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:56.211033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:56.217864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:56.218350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:56.218780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:56.219476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:56.219972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:56.220393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:56.252350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3ed62bf1-bbbd-48b3-be5b-beeb99b94d8a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/973a697e-79b8-47e2-854c-e20cbec24833" status: 200 len: 194 microversion: 2.1 time: 0.045820 Aug 05 05:18:56.252941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 318/626] 10.222.0.30 () {58 vars in 1413 bytes} [Fri Aug 5 05:18:56 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/973a697e-79b8-47e2-854c-e20cbec24833 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:57.011708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:57.012554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:57.020163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:57.020648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:57.021070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:57.022501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:57.022947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:57.023358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:57.153542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:57.162741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:57.164353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:57.165537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b3157b5e-397d-49ca-b1ee-2274fabf4e2e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.159212 Aug 05 05:18:57.166086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 309/627] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:57 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:57.612821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "715b3c85-11eb-4f06-a405-8b472b417662"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:18:57.615120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:57.622048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:57.622524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:57.622953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:57.623693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:57.624168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:57.624583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:57.921402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-be1f05b4-7b20-44de-b376-6190905e5a06 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "POST /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312369 Aug 05 05:18:57.927180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 319/628] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:18:57 2022] POST /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:18:58.188939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:58.189465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:58.196275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:58.196765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:58.197202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:58.197936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:58.198373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:58.198793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:58.335468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:58.343893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:58.345479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:58.346648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-473ae22f-9151-42fe-ba24-c1661004f9e9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.161828 Aug 05 05:18:58.347213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 310/629] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:58 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:18:59.375413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:18:59.376557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:18:59.387043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:59.387858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:59.388599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:59.389739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:18:59.390574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:18:59.391292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:18:59.532559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:59.545286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:59.547497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:18:59.548717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-47b73faa-da9e-4476-a3f3-23406d1a6531 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.181628 Aug 05 05:18:59.549285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 320/630] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:18:59 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:00.576773 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:00.577696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:00.588711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:00.589501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:00.590207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:00.591339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:00.592134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:00.592816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:00.730753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:00.738850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:00.740429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:00.741587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-63cb4c3e-858d-4cdd-a881-2a5b4add6782 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1744 microversion: 2.20 time: 0.171482 Aug 05 05:19:00.742146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 311/631] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:00 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:01.765032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:01.765619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:01.772820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:01.773306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:01.773743 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:01.774440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:01.774889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:01.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:01.906873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:01.915438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:01.916970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:01.918135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eaa8e68d-5f4b-4f83-87cd-7b8520b6df73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1744 microversion: 2.20 time: 0.157075 Aug 05 05:19:01.918696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 321/632] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:01 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:02.942449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:02.943187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:02.950588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:02.951163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:02.951668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:02.952622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:02.953060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:02.953552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:03.089193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:03.097647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:03.099265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:03.100576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-496e39dd-79a5-410b-aa9e-2486fe7ec07d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.162798 Aug 05 05:19:03.101089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 312/633] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:02 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:03.644238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-5d558a5b-f8b9-466f-ab1f-fd872b8c03bf req-a2200197-08c6-433a-a5a7-465af4aa3559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:03.654252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5d558a5b-f8b9-466f-ab1f-fd872b8c03bf req-a2200197-08c6-433a-a5a7-465af4aa3559 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:03.654845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5d558a5b-f8b9-466f-ab1f-fd872b8c03bf req-a2200197-08c6-433a-a5a7-465af4aa3559 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:03.655480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5d558a5b-f8b9-466f-ab1f-fd872b8c03bf req-a2200197-08c6-433a-a5a7-465af4aa3559 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:03.669650 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-5d558a5b-f8b9-466f-ab1f-fd872b8c03bf req-a2200197-08c6-433a-a5a7-465af4aa3559 service nova] Creating event network-vif-plugged:98cad295-2ec9-44a3-9512-556b38096e67 for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc on hv-cinder-81558 Aug 05 05:19:03.674981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-5d558a5b-f8b9-466f-ab1f-fd872b8c03bf req-a2200197-08c6-433a-a5a7-465af4aa3559 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180761 Aug 05 05:19:03.676142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 322/634] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:04.123281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:04.124444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:04.138289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:04.138767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:04.139207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:04.144250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:04.145019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:04.145458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:04.288250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:04.297025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:04.298820 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:04.300455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-08a435b4-40b9-4444-a37a-17a9092e8b68 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.181209 Aug 05 05:19:04.301094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 313/635] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:04 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:05.331412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:05.332841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:05.339841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.340876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.341296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.342244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.343011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.343657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.521715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:05.524593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:05.531262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.531982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.532593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.533354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.534002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.534424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.561854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:05.566539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6983f057-90e4-455f-8c8f-618e68df9f94 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048253 Aug 05 05:19:05.567346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 314/636] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:19:05 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:19:05.574443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:05.576006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:05.577188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-146097b4-e21f-448f-a89b-d4eca660871b tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.250289 Aug 05 05:19:05.577738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 323/637] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:05 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:05.711500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:05.712021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:05.718980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.719477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.719939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.720720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.721169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.721587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.758019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b21ae7ba-450a-48f8-89d2-9148f2b19d53 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/973a697e-79b8-47e2-854c-e20cbec24833" status: 200 len: 194 microversion: 2.1 time: 0.050639 Aug 05 05:19:05.758648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 315/638] 10.222.0.30 () {58 vars in 1413 bytes} [Fri Aug 5 05:19:05 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/973a697e-79b8-47e2-854c-e20cbec24833 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:05.769670 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:05.770264 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:05.777196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.777778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.778284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.779090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:05.779611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:05.780078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:05.888344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:05.892895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lazy-loading 'services' on Instance uuid b39f89ed-d391-4030-8013-2f436e3e3950 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:19:05.983153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3aeb75a1-4fc5-4d9c-8ea6-4c237de1ea21 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/973a697e-79b8-47e2-854c-e20cbec24833" status: 202 len: 0 microversion: 2.1 time: 0.217487 Aug 05 05:19:05.987262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 324/639] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:19:05 2022] DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/973a697e-79b8-47e2-854c-e20cbec24833 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:19:06.601910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:06.602437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:06.613337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:06.614051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:06.614469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:06.615308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:06.615944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:06.616348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:06.761640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:06.770181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:06.772009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:06.773414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f80deaf6-40c5-4962-91cb-67c725267e27 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.175560 Aug 05 05:19:06.774301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 316/640] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:06 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:07.797712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:07.799203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:07.805865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:07.806575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:07.807208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:07.808278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:07.809007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:07.809591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:07.953221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:07.968497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:07.970362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:07.971734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-30856fde-e3dc-4a75-b0e6-0805cf77e29e tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.179064 Aug 05 05:19:07.972362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 325/641] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:07 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:08.189449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:08.189937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:08.197360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:08.197535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:08.197909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:08.198857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:08.204173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:08.205039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:08.236805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a0b9cf8e-625b-4979-8140-bfc8eaa01a9c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/715b3c85-11eb-4f06-a405-8b472b417662" status: 200 len: 194 microversion: 2.1 time: 0.051357 Aug 05 05:19:08.237670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 317/642] 10.222.0.30 () {58 vars in 1413 bytes} [Fri Aug 5 05:19:08 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/715b3c85-11eb-4f06-a405-8b472b417662 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:08.249757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:08.250345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:08.257325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:08.258608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:08.259117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:08.259935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:08.260455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:08.260941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:08.356437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lazy-loading 'services' on Instance uuid b39f89ed-d391-4030-8013-2f436e3e3950 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:19:08.458002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7ad9ff73-8f8d-4cad-ad16-38d87068bf2a tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/715b3c85-11eb-4f06-a405-8b472b417662" status: 202 len: 0 microversion: 2.1 time: 0.212472 Aug 05 05:19:08.458975 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 326/643] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:19:08 2022] DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments/715b3c85-11eb-4f06-a405-8b472b417662 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:19:08.998678 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:08.999649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:09.010681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.011477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.012149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.013075 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.013725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.014342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.162875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:09.167360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:09.172513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:09.175236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:09.175497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-444b3ef1-e5a5-4582-ad9b-3479d8035553 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.180802 Aug 05 05:19:09.176237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 318/644] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:08 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:09.664218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:09.666783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:09.673739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.674218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.674645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.675333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.675819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.676216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.714984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3e60c427-217e-46e0-9ca3-6b52999b5c4f tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060682 Aug 05 05:19:09.715580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 327/645] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:19:09 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:19:09.849217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:09.852086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:09.863933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.865165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.865785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.866489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.866934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.867350 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.904585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d7594d67-13b4-4b70-9d95-bcde58760ebd tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062792 Aug 05 05:19:09.910408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 319/646] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:19:09 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:19:09.968520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:09.969014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:09.975605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.976151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.976588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:09.977279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:09.977721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:09.978148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:10.009859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:19:10.121513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ba263d25-73ed-4b01-9112-3aabc0ab8487 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 204 len: 0 microversion: 2.1 time: 0.155177 Aug 05 05:19:10.125675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 328/647] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:19:09 2022] DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:19:10.131491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:10.132255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:10.147945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:10.148440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:10.149048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:10.149811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:10.150309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:10.150746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:10.201994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:10.202709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:10.215120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:10.215602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:10.216050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:10.216740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:10.217181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:10.217592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:10.344853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:10.353044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-65d30241-72d0-4d25-b162-c0c7d236b11b tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1673 microversion: 2.1 time: 0.225954 Aug 05 05:19:10.367234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 320/648] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:10 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:10.398417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:10.406729 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:10.408279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:10.410394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b3ccd65a-9641-4cc1-9d5f-b0b001ef32e7 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.215759 Aug 05 05:19:10.411484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 329/649] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:10 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:19:11.374984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:11.375658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:11.382364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:11.382867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:11.383306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:11.384040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:11.384488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:11.384921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:11.434034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:11.434627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:11.446085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:11.446568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:11.446999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:11.447714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:11.448285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:11.448716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:11.592484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:11.600189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-47062d75-e0ae-4dc6-997a-e0cd9052a6d1 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1673 microversion: 2.1 time: 0.229270 Aug 05 05:19:11.614390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 321/650] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:11 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:11.631031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:11.641238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:11.642836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:11.644050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4d149f92-bdec-4d39-8b6e-5f92062d54b2 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1739 microversion: 2.20 time: 0.213869 Aug 05 05:19:11.659283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 330/651] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:11 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:12.621355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:12.622112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:12.629239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:12.629856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:12.630496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:12.631391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:12.631885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:12.632519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:12.668269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:12.669241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:12.678259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:12.678979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:12.680400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:12.681211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:12.681659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:12.682073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:12.944573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:12.953193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-28bd57f4-f9c1-4678-b43d-8cde65e68f52 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1673 microversion: 2.1 time: 0.335755 Aug 05 05:19:12.954358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 322/652] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:12 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1673 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:12.981093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:12.989621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:12.991824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:12.993287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0066b405-9d5b-4edb-abdd-3a27b43ab63a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1721 microversion: 2.20 time: 0.329164 Aug 05 05:19:13.003848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 331/653] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:12 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:13.474957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-966a6ff4-6444-43fa-8cb3-59cb4328ff5d req-18968254-53c4-484c-98b6-ef63abda1e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f89ed-d391-4030-8013-2f436e3e3950", "name": "network-vif-deleted", "tag": "0325c509-c7b4-45f1-bcfa-cc99cc230fb0"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:13.484623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-966a6ff4-6444-43fa-8cb3-59cb4328ff5d req-18968254-53c4-484c-98b6-ef63abda1e42 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:13.485072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-966a6ff4-6444-43fa-8cb3-59cb4328ff5d req-18968254-53c4-484c-98b6-ef63abda1e42 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:13.485524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-966a6ff4-6444-43fa-8cb3-59cb4328ff5d req-18968254-53c4-484c-98b6-ef63abda1e42 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:13.497308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-966a6ff4-6444-43fa-8cb3-59cb4328ff5d req-18968254-53c4-484c-98b6-ef63abda1e42 service nova] Creating event network-vif-deleted:0325c509-c7b4-45f1-bcfa-cc99cc230fb0 for instance b39f89ed-d391-4030-8013-2f436e3e3950 on hv-cinder-81558 Aug 05 05:19:13.502490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-966a6ff4-6444-43fa-8cb3-59cb4328ff5d req-18968254-53c4-484c-98b6-ef63abda1e42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092093 Aug 05 05:19:13.503389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 323/654] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:13.976568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:13.977191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:13.986617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:13.987265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:13.987862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:13.988821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:13.989462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:13.990047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:14.027233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:14.028973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:14.036504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:14.037007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:14.037714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:14.038397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:14.039166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:14.039926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:14.064016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:14.072137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a9749088-0276-4933-9266-fd80116a3b84 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1605 microversion: 2.1 time: 0.101181 Aug 05 05:19:14.072727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 332/655] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:13 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:14.176401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:14.185682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:14.187209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:14.188442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e69da2c7-6b6b-46fa-9cc2-46711e662c77 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1721 microversion: 2.20 time: 0.165992 Aug 05 05:19:14.189009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 324/656] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:14 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:19:15.097809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:15.098693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:15.109559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.110330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.111222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.111946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.112397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.112822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.144466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.144973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.145399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.145828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lazy-loading 'fault' on Instance uuid b39f89ed-d391-4030-8013-2f436e3e3950 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:19:15.190066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04eb412804c247908f8d377a42d1ea63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c58f39e03f42d5862a6a64194f5711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:15.199237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2f2354d1-e56d-444f-bb18-a8154bc4f893 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 200 len: 1328 microversion: 2.1 time: 0.108121 Aug 05 05:19:15.200325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 333/657] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:15 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:15.210926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:15.212670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:15.219173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.219648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.220100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.220783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.221220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.221630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.356617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:15.364736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:15.366245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:15.367459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-30f668d6-04b7-4ce0-977d-e0126d74cee3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1724 microversion: 2.20 time: 0.160620 Aug 05 05:19:15.368129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 325/658] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:15 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:15.390265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef99a3f7-d8c4-4f00-ae4b-acd4cbe4c3af"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:15.392714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:15.399073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.399557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.400017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.400704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.401143 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.401566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.520919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-bb270359-60a9-4164-ac89-a07231ead236 req-d9934c70-dccb-4bcf-99cf-5c0027759a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "name": "network-vif-unplugged", "status": "completed", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:15.530643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bb270359-60a9-4164-ac89-a07231ead236 req-d9934c70-dccb-4bcf-99cf-5c0027759a1b service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.531109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bb270359-60a9-4164-ac89-a07231ead236 req-d9934c70-dccb-4bcf-99cf-5c0027759a1b service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.531910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bb270359-60a9-4164-ac89-a07231ead236 req-d9934c70-dccb-4bcf-99cf-5c0027759a1b service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.545207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.compute.server_external_events [req-bb270359-60a9-4164-ac89-a07231ead236 req-d9934c70-dccb-4bcf-99cf-5c0027759a1b service nova] Unable to find a host for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc. Dropping event network-vif-unplugged {{(pid=117903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 05:19:15.546624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-bb270359-60a9-4164-ac89-a07231ead236 req-d9934c70-dccb-4bcf-99cf-5c0027759a1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034313 Aug 05 05:19:15.547227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 326/659] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 05 05:19:15.730279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b54afe7f-9bd7-4b1e-b8fb-d0f1230b4d23 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344037 Aug 05 05:19:15.730973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 334/660] 10.222.0.30 () {62 vars in 1364 bytes} [Fri Aug 5 05:19:15 2022] POST /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:19:15.853266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:15.853757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:15.860041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.860524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.861107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:15.861821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:15.862247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:15.862667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.120189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4073d4e2-9e2f-4a79-8768-dbb508c218db tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-volume_attachments/ef99a3f7-d8c4-4f00-ae4b-acd4cbe4c3af" status: 202 len: 0 microversion: 2.20 time: 0.270850 Aug 05 05:19:16.120795 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 327/661] 10.222.0.30 () {60 vars in 1457 bytes} [Fri Aug 5 05:19:15 2022] DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-volume_attachments/ef99a3f7-d8c4-4f00-ae4b-acd4cbe4c3af => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:19:16.184436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:16.184973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:16.191987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.192498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.192924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.193600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.194045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.194455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.212684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=5 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:16.221392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:16.222016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:16.229463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.229640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117902) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 05:19:16.229954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.230440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.231170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.231627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.232083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.246500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] HTTP exception thrown: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Request method failure captured: Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 HTTP/1.1 Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7Kbng02UfywowbLJkzlaE9JAlqvL6i2c00ZbPf3RsDjhcJ2MfuW3TVUM0Sj-NFrQn_-lQ-QhmxKOd1AVL1XWU9x21vHUgwzEBofLgMedUTmMLAFv2If4b2qYFNtn2W3u-JYLIS2HY5LTdw0_N2qm86WGRqqz5H6nnUlNQnMEWpsrAyc Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:19:16.248087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c58f39e03f42d5862a6a64194f5711", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 04eb412804c247908f8d377a42d1ea63 Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:16.249531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'b39f89ed-d391-4030-8013-2f436e3e3950'} Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:19:16.250383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:16.251702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:16.253316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Returning 404 to user: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:19:16.253316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6323740e-9ba3-4804-97a9-29bdebc3f74c tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 404 len: 111 microversion: 2.1 time: 0.033134 Aug 05 05:19:16.254487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 328/662] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:16 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:16.259070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ced80627-7ae5-4779-b375-802cc23318c6 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '.version_select at 0x7fdc9dacae50>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:16.278924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ced80627-7ae5-4779-b375-802cc23318c6 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886871404" status: 202 len: 0 microversion: 2.1 time: 0.023319 Aug 05 05:19:16.279896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 329/663] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Aug 5 05:19:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886871404 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:19:16.301945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-88e79a2e-e2cc-4a08-94f3-aa63c0f04857 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "POST /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/action" status: 202 len: 0 microversion: 2.20 time: 0.121537 Aug 05 05:19:16.302962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 335/664] 10.222.0.30 () {62 vars in 1319 bytes} [Fri Aug 5 05:19:16 2022] POST /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:19:16.311137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:16.311853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:16.319472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.320061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.320596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.321343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.321974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.322606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.504283 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:16.516211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:16.518034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:16.519301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-71bf88ad-fafa-4e90-bcac-439f81383ac3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1672 microversion: 2.20 time: 0.212307 Aug 05 05:19:16.520150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 330/665] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:16 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1672 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 05:19:16.924497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:16.924769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:16.930991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.931473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.931951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.932642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:16.933093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:16.933513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:16.958068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1aba3aaa-9468-47c1-8452-a474450bd2d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/ips" status: 200 len: 149 microversion: 2.1 time: 0.037946 Aug 05 05:19:16.959059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 336/666] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:19:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:19:17.543279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:17.543897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:17.550907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:17.551396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:17.551845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:17.552541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:17.552992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:17.553404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:17.699805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:17.708423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:17.709963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:17.711115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-aa1b4b8f-2c76-4c0d-9095-28a00139bc4f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1674 microversion: 2.20 time: 0.171916 Aug 05 05:19:17.711668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 331/667] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:17 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:18.369361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b37617a0-7259-4090-8a5e-af31cc2d4c2f"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:18.371860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:18.378558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:18.379101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:18.379538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:18.380257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:18.380706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:18.381126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:18.700724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-254a63f0-6f05-4aea-a272-a0ebf4badfed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335189 Aug 05 05:19:18.701328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 337/668] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:19:18 2022] POST /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:18.734590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:18.735201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:18.742185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:18.742681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:18.743095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:18.743853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:18.744299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:18.744700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:18.884112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:18.893108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:18.894594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:18.895752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-876ef14b-a968-4dba-b5fe-10158b1cab6f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.165259 Aug 05 05:19:18.896315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 332/669] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:18 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:19.280018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:19.280715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:19.288196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:19.288765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:19.289423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:19.290206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:19.290720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:19.291207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:19.307791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] HTTP exception thrown: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Request method failure captured: Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 HTTP/1.1 Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7Kbng02UfywowbLJkzlaE9JAlqvL6i2c00ZbPf3RsDjhcJ2MfuW3TVUM0Sj-NFrQn_-lQ-QhmxKOd1AVL1XWU9x21vHUgwzEBofLgMedUTmMLAFv2If4b2qYFNtn2W3u-JYLIS2HY5LTdw0_N2qm86WGRqqz5H6nnUlNQnMEWpsrAyc Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:19:19.310095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c58f39e03f42d5862a6a64194f5711", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 04eb412804c247908f8d377a42d1ea63 Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.311984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'b39f89ed-d391-4030-8013-2f436e3e3950'} Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:19:19.313016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.315075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.318201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Returning 404 to user: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:19:19.319076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fdc2b03a-2589-46ce-bdd7-55be8eb0ceb0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 404 len: 111 microversion: 2.1 time: 0.043407 Aug 05 05:19:19.319832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 338/670] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:19:19 2022] DELETE /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:19.328263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:19.328874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: b39f89ed-d391-4030-8013-2f436e3e3950] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:19.335552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:19.336094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:19.336523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:19.337216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:19.337666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:19.338266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:19.352496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] HTTP exception thrown: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Request method failure captured: Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 HTTP/1.1 Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7Kbng02UfywowbLJkzlaE9JAlqvL6i2c00ZbPf3RsDjhcJ2MfuW3TVUM0Sj-NFrQn_-lQ-QhmxKOd1AVL1XWU9x21vHUgwzEBofLgMedUTmMLAFv2If4b2qYFNtn2W3u-JYLIS2HY5LTdw0_N2qm86WGRqqz5H6nnUlNQnMEWpsrAyc Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:19:19.355786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c58f39e03f42d5862a6a64194f5711", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 04eb412804c247908f8d377a42d1ea63 Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'b39f89ed-d391-4030-8013-2f436e3e3950'} Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:19:19.358170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. Aug 05 05:19:19.359500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:19.361725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Returning 404 to user: Instance b39f89ed-d391-4030-8013-2f436e3e3950 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:19:19.362802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e0952695-2076-4f4e-8165-15303510a169 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950" status: 404 len: 111 microversion: 2.1 time: 0.038672 Aug 05 05:19:19.366934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 333/671] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:19 2022] GET /compute/v2.1/servers/b39f89ed-d391-4030-8013-2f436e3e3950 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:19.922402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:19.923608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:19.932556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:19.933036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:19.933493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:19.934225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:19.934671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:19.935121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:20.079109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:20.087274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:20.088779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:20.089930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b8efd946-1699-46ad-8514-0e01eb71f991 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.174465 Aug 05 05:19:20.090490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 339/672] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:19 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:20.546537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:20.547037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:20.553918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:20.554412 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:20.554858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:20.555563 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:20.556098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:20.556521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:20.572636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] HTTP exception thrown: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Request method failure captured: Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c HTTP/1.1 Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7Kbng02UfywowbLJkzlaE9JAlqvL6i2c00ZbPf3RsDjhcJ2MfuW3TVUM0Sj-NFrQn_-lQ-QhmxKOd1AVL1XWU9x21vHUgwzEBofLgMedUTmMLAFv2If4b2qYFNtn2W3u-JYLIS2HY5LTdw0_N2qm86WGRqqz5H6nnUlNQnMEWpsrAyc Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:19:20.574206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c58f39e03f42d5862a6a64194f5711", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 04eb412804c247908f8d377a42d1ea63 Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.575826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '0058bb72-4d0a-4cd2-ace4-549ebc5f018c'} Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:19:20.576538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.577699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.580262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Returning 404 to user: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:19:20.581328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9186167-b0c2-4805-9840-27848bcb58d0 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 404 len: 111 microversion: 2.1 time: 0.038750 Aug 05 05:19:20.585453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 334/673] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:19:20 2022] DELETE /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:20.590472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:20.591142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] [instance: 0058bb72-4d0a-4cd2-ace4-549ebc5f018c] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:20.598162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:20.598652 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:20.599089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:20.599831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:20.600306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:20.600724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:20.614814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] HTTP exception thrown: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Request method failure captured: Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c HTTP/1.1 Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7Kbng02UfywowbLJkzlaE9JAlqvL6i2c00ZbPf3RsDjhcJ2MfuW3TVUM0Sj-NFrQn_-lQ-QhmxKOd1AVL1XWU9x21vHUgwzEBofLgMedUTmMLAFv2If4b2qYFNtn2W3u-JYLIS2HY5LTdw0_N2qm86WGRqqz5H6nnUlNQnMEWpsrAyc Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:19:20.616424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_27c58f39e03f42d5862a6a64194f5711", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/27c58f39e03f42d5862a6a64194f5711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 27c58f39e03f42d5862a6a64194f5711 Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173530437 Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 04eb412804c247908f8d377a42d1ea63 Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeTestJSON-173530437-project Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.617993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '0058bb72-4d0a-4cd2-ace4-549ebc5f018c'} Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:19:20.618779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. Aug 05 05:19:20.620268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:19:20.621529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] Returning 404 to user: Instance 0058bb72-4d0a-4cd2-ace4-549ebc5f018c could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:19:20.621529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-788ab249-fda9-4413-a51d-506aa109cda4 tempest-AttachVolumeTestJSON-173530437 tempest-AttachVolumeTestJSON-173530437-project] 10.222.0.30 "GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c" status: 404 len: 111 microversion: 2.1 time: 0.031287 Aug 05 05:19:20.621529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 340/674] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:20 2022] GET /compute/v2.1/servers/0058bb72-4d0a-4cd2-ace4-549ebc5f018c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:19:21.113560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:21.114634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:21.121500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:21.122402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:21.123180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:21.123914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:21.124638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:21.125375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:21.594148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:21.604705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:21.606586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:21.607884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9055585b-7abe-4bd8-be59-5c5161457069 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.499329 Aug 05 05:19:21.608507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 335/675] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:21 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:22.630853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:22.632213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:22.639107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:22.640119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:22.640817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:22.648345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:22.649152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:22.649992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:22.830307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:22.841495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:22.843823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:22.845427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-888e8caf-ea63-4916-acdd-ed4498905b85 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.218732 Aug 05 05:19:22.846211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 341/676] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:22 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:23.870403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:23.871994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:23.879120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:23.879995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:23.880645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:23.881725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:23.882394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:23.883039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:24.102668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:24.112628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:24.121425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:24.125701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5527159e-6970-4b5d-aa6b-289673a56bb3 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.259611 Aug 05 05:19:24.126627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 336/677] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:23 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:25.154362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:25.154977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:25.164812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:25.165455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:25.165917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:25.166699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:25.167110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:25.167759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:25.369921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:25.381496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:25.383424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:25.385070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4205d071-ce4e-40a1-8687-ef3e7e2de281 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.234689 Aug 05 05:19:25.385630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 342/678] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:25 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:26.410049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:26.412737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:26.415699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:26.422948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:26.423513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:26.423994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:26.424747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:26.425206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:26.425621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:26.445134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:26.677845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:26.687032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:26.688561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:26.690018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1d7626ff-7af2-4065-8fc4-bd32b51f14ca tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.285456 Aug 05 05:19:26.691053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 337/679] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:26 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:27.712957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:27.713644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:27.716293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:27.721686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:27.722249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:27.722771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:27.723548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:27.724094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:27.724581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:27.944844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:27.953129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:27.954601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:27.955804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2d4b35c6-6437-4907-8b45-f58de8aee804 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.246821 Aug 05 05:19:27.956558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 343/680] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:27 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:28.978477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:28.979148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:28.985981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:28.986466 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:28.986898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:28.987598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:28.988098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:28.988521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:29.233589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:29.242311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:29.243978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:29.245154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-af95d968-3aa3-41e3-bc5a-486179b09466 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.270659 Aug 05 05:19:29.245698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 338/681] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:28 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:29.609672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-877aa93d-67f5-4905-ab36-0fb3af7f1567 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: .version_select at 0x7fdc9dab0b80>, body: {"keypair": {"name": "tempest-keypair-1255391015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUlfVddbFwZY066z+LqpGLzCftjQMufiNni2xZveDBzpr9eFoDA6GWSuhyBp3yndCqYsJOjJG95Rw/1C1DlTm3uQ+ytYj4n4gN2+SBi0+PtRiMjUwnxquRs83/JThIsWQ=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:29.628626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-877aa93d-67f5-4905-ab36-0fb3af7f1567 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:19:29.633521 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-877aa93d-67f5-4905-ab36-0fb3af7f1567 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:19:29.660668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-877aa93d-67f5-4905-ab36-0fb3af7f1567 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054948 Aug 05 05:19:29.662889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 344/682] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:19:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:30.268223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:30.269473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:30.276618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:30.277394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:30.278102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:30.279142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:30.279943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:30.280332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:30.427826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:30.439867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:30.440884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:30.442056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5ca9005a-837a-4c17-8e58-70f0ec51e371 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.178398 Aug 05 05:19:30.442605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 339/683] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:30 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:31.053863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-910098996", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dfb9760-7f7c-4d72-90dd-3ced7593c930"}], "security_groups": [{"name": "tempest-securitygroup--120097037"}], "key_name": "tempest-keypair-1255391015", "user_data": "}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:31.156192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] validate_networks() for [('8dfb9760-7f7c-4d72-90dd-3ced7593c930', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:19:31.465594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:31.466825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:31.473150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:31.473633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:31.474061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:31.474740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:31.475185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:31.475594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:31.707165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:31.716342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:31.716812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:19:31.717230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:19:31.717689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:19:31.718254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:19:31.718636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:31.719017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:19:31.719907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8e19fa80-97fe-4410-8429-f912bd3b5f0a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.258295 Aug 05 05:19:31.720537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 340/684] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:31 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:31.725326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-f0a319a6-0c81-4568-95f9-e17f992fb092 req-99bed57d-320c-44d7-814a-108806182383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "name": "network-vif-plugged", "status": "completed", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:31.729028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:31.729512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:31.729937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:31.730777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:31.731331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:31.732054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:31.735819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f0a319a6-0c81-4568-95f9-e17f992fb092 req-99bed57d-320c-44d7-814a-108806182383 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:31.736298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f0a319a6-0c81-4568-95f9-e17f992fb092 req-99bed57d-320c-44d7-814a-108806182383 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:31.736893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-f0a319a6-0c81-4568-95f9-e17f992fb092 req-99bed57d-320c-44d7-814a-108806182383 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:31.748101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-f0a319a6-0c81-4568-95f9-e17f992fb092 req-99bed57d-320c-44d7-814a-108806182383 service nova] Creating event network-vif-plugged:98cad295-2ec9-44a3-9512-556b38096e67 for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc on hv-cinder-81558 Aug 05 05:19:31.750740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:19:31.753609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-f0a319a6-0c81-4568-95f9-e17f992fb092 req-99bed57d-320c-44d7-814a-108806182383 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Aug 05 05:19:31.754563 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 341/685] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:31.756875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:19:31.768542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:19:31.770858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:19:31.817908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5bbca375-1d90-418e-8744-6146d8f9fc90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.768941 Aug 05 05:19:31.818562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 345/686] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:19:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:19:31.830244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-133bb42d-942d-4f20-a3f3-ce9207dd19a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:31.831001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-133bb42d-942d-4f20-a3f3-ce9207dd19a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:31.900724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-133bb42d-942d-4f20-a3f3-ce9207dd19a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:31.910613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-133bb42d-942d-4f20-a3f3-ce9207dd19a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1241 microversion: 2.1 time: 0.084712 Aug 05 05:19:31.911549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 342/687] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:31 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:32.743391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:32.744008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:32.750612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:32.751085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:32.751685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:32.752495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:32.752952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:32.753490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:32.899144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:32.909212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:32.911688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:32.913278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-54224f40-406f-4d59-aae8-acec14b0196f tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.174550 Aug 05 05:19:32.913830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 346/688] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:32 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:32.935908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:32.937658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:32.946399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:32.946802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:32.947320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:32.947978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:32.948416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:32.948754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:33.016065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:33.023636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1e6435bd-2d34-4f37-8387-c98e7b13b430 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1293 microversion: 2.1 time: 0.093628 Aug 05 05:19:33.024234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 343/689] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:32 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:33.936341 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:33.936938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:33.946875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:33.950279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:33.954131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:33.955304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:33.956014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:33.957086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:34.045294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:34.046990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:34.053383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:34.053865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:34.054292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:34.054970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:34.055440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:34.055887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:34.113862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:34.122559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:34.124204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:34.125411 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-847b837c-a1d0-4086-b8f3-e2dd51b92058 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1730 microversion: 2.20 time: 0.192972 Aug 05 05:19:34.126000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 347/690] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:33 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:34.127392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:34.136095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6b2778e-9e47-46c0-bcdb-f59bbe09e398 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1299 microversion: 2.1 time: 0.094807 Aug 05 05:19:34.141772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 344/691] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:34 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:35.148596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:35.149307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:35.157955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:35.158704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:35.159400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:35.160187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:35.160316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:35.161556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:35.162225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:35.162828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:35.169740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:35.170460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:35.171078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:35.172180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:35.172939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:35.173525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:35.436577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:35.445464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:35.447251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:35.448600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e3d98bb7-7901-463d-b87f-ccbab0a88e7d tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1717 microversion: 2.20 time: 0.304185 Aug 05 05:19:35.464000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 348/692] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:19:35 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1717 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:19:35.469083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:35.478201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-618afab4-e7a1-4eab-bd83-5e18088a6552 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.325178 Aug 05 05:19:35.478864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 345/693] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:35 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:35.500424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-7a729304-94b6-457f-bc5a-b82b9558a09a req-fc40e560-ff71-4ccb-93e8-81cb5c85ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac3edaa-53ee-49c7-b154-c73b0d93e41f", "tag": "25f9b321-a1c5-45c6-a82e-7c00f737ce09"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:35.512041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7a729304-94b6-457f-bc5a-b82b9558a09a req-fc40e560-ff71-4ccb-93e8-81cb5c85ea6f service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:35.512932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7a729304-94b6-457f-bc5a-b82b9558a09a req-fc40e560-ff71-4ccb-93e8-81cb5c85ea6f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:35.513625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7a729304-94b6-457f-bc5a-b82b9558a09a req-fc40e560-ff71-4ccb-93e8-81cb5c85ea6f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:35.526613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-7a729304-94b6-457f-bc5a-b82b9558a09a req-fc40e560-ff71-4ccb-93e8-81cb5c85ea6f service nova] Creating event network-changed:25f9b321-a1c5-45c6-a82e-7c00f737ce09 for instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f on hv-cinder-81558 Aug 05 05:19:35.532020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-7a729304-94b6-457f-bc5a-b82b9558a09a req-fc40e560-ff71-4ccb-93e8-81cb5c85ea6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035093 Aug 05 05:19:35.540060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 349/694] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:36.504601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:36.505518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:36.516795 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:36.517611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:36.518374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:36.519558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:36.520352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:36.521095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:36.661817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:36.669394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-332ed673-aebe-4521-ba2d-27de98d4324b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.171580 Aug 05 05:19:36.670007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 346/695] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:36 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:37.696088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:37.697281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:37.706992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:37.707452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:37.707942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:37.708623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:37.709067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:37.709479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:37.849519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:37.857432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ac3c6f3c-8ee7-433f-966a-6fbde4372ab6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.169431 Aug 05 05:19:37.857984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 350/696] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:37 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:38.878979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:38.879592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:38.885777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:38.886256 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:38.886686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:38.887366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:38.887842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:38.888262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:39.027723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:39.035630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-34a32804-ffce-4b23-9cc3-63efa3b3a6b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.160769 Aug 05 05:19:39.036606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 347/697] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:38 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:40.056394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:40.057687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:40.065111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:40.065724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:40.066226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:40.066989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:40.067501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:40.068027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:40.208229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:40.217609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8e353a45-f9d5-4603-82db-83cf4f261fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.165007 Aug 05 05:19:40.218870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 351/698] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:40 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:41.240043 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:41.240670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:41.262890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:41.263890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:41.264339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:41.265082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:41.265530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:41.265954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:41.408330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:41.416532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bf54b996-06c6-4b80-acd3-cd02f422a582 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.181311 Aug 05 05:19:41.417181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 348/699] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:41 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:41.636765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-749c8aa7-8a71-4bba-a96e-e98f59ff7668 req-47a76c9d-5c97-480d-a96c-5fb774e04e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac3edaa-53ee-49c7-b154-c73b0d93e41f", "name": "network-vif-plugged", "status": "completed", "tag": "25f9b321-a1c5-45c6-a82e-7c00f737ce09"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:41.648719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-749c8aa7-8a71-4bba-a96e-e98f59ff7668 req-47a76c9d-5c97-480d-a96c-5fb774e04e56 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:41.649198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-749c8aa7-8a71-4bba-a96e-e98f59ff7668 req-47a76c9d-5c97-480d-a96c-5fb774e04e56 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:41.649628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-749c8aa7-8a71-4bba-a96e-e98f59ff7668 req-47a76c9d-5c97-480d-a96c-5fb774e04e56 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:41.663386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-749c8aa7-8a71-4bba-a96e-e98f59ff7668 req-47a76c9d-5c97-480d-a96c-5fb774e04e56 service nova] Creating event network-vif-plugged:25f9b321-a1c5-45c6-a82e-7c00f737ce09 for instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f on hv-cinder-81558 Aug 05 05:19:41.668762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-749c8aa7-8a71-4bba-a96e-e98f59ff7668 req-47a76c9d-5c97-480d-a96c-5fb774e04e56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Aug 05 05:19:41.669498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 352/700] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:42.438745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:42.439486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:42.441499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:42.448740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:42.449340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:42.449775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:42.450450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:42.450912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:42.451315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:42.586555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:42.594228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-33e4791e-1bf1-4542-9830-590887cb722c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1366 microversion: 2.1 time: 0.159456 Aug 05 05:19:42.594791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 349/701] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:42 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:43.611962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:43.612878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=10 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:43.617545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:43.618400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:43.626084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:43.626555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:43.627040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:43.627898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:43.628427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:43.628898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:43.774830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:43.782809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-56684351-b3d6-4b91-98a5-670e0864828c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1555 microversion: 2.1 time: 0.171870 Aug 05 05:19:43.783821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 353/702] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:43 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:43.804125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:43.805275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:43.811721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:43.812258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:43.812802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:43.813361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:43.814163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:43.814550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:43.896200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9b90691f-67c4-4ae8-bc2b-ba3ddc75f9aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096117 Aug 05 05:19:43.896960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 350/703] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:19:43 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:44.865948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-c5764adf-157c-4889-8697-0f43897b4a0e req-5505c783-0304-4f5d-a595-067e53c657bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac3edaa-53ee-49c7-b154-c73b0d93e41f", "tag": "25f9b321-a1c5-45c6-a82e-7c00f737ce09"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:44.876917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-c5764adf-157c-4889-8697-0f43897b4a0e req-5505c783-0304-4f5d-a595-067e53c657bf service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:44.877467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-c5764adf-157c-4889-8697-0f43897b4a0e req-5505c783-0304-4f5d-a595-067e53c657bf service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:44.878573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-c5764adf-157c-4889-8697-0f43897b4a0e req-5505c783-0304-4f5d-a595-067e53c657bf service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:44.895708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-c5764adf-157c-4889-8697-0f43897b4a0e req-5505c783-0304-4f5d-a595-067e53c657bf service nova] Creating event network-changed:25f9b321-a1c5-45c6-a82e-7c00f737ce09 for instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f on hv-cinder-81558 Aug 05 05:19:44.901109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-c5764adf-157c-4889-8697-0f43897b4a0e req-5505c783-0304-4f5d-a595-067e53c657bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039986 Aug 05 05:19:44.902119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 354/704] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:19:51.343401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1660972449", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "networks": [{"uuid": "0410cf0d-36ab-4b32-9bfe-a6d3945b1d52"}]}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:51.399574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] validate_networks() for [('0410cf0d-36ab-4b32-9bfe-a6d3945b1d52', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:19:51.767493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:19:51.768011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:19:51.768417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:19:51.768816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:19:51.769217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:19:51.778425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:51.778900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:51.779323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:51.780077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:51.780520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:51.780934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:51.798268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Getting quotas for project 0af046d32c704d8bb13b821da2b8338a. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:19:51.802686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Getting quotas for user 06de5afa7d2d4d3aa0c1378ceeb5c4bf and project 0af046d32c704d8bb13b821da2b8338a. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:19:51.815344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:19:51.817696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:19:51.863161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9f9d8c4e-b0b1-4dd8-8b3a-6abffa2b0081 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526561 Aug 05 05:19:51.863965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 351/705] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:19:51.876272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a7ead479-051f-4f04-9dab-38df6803fa7c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:51.876961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a7ead479-051f-4f04-9dab-38df6803fa7c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:51.935667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a7ead479-051f-4f04-9dab-38df6803fa7c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:51.942540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a7ead479-051f-4f04-9dab-38df6803fa7c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1219 microversion: 2.1 time: 0.071323 Aug 05 05:19:51.943293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 355/706] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:51 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:52.963479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:52.964114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:52.970368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:52.970909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:52.971359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:52.972072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:52.972528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:52.972929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:53.082959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:53.091100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9f680cae-a350-4014-a32a-9b41ec448263 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1279 microversion: 2.1 time: 0.132080 Aug 05 05:19:53.092571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 352/707] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:52 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:54.112992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:54.112992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:54.121405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:54.121886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:54.122312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:54.122999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:54.123439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:54.123843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:54.127320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:54.376576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:54.384594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1515ba64-8db7-402d-9c31-e1f29de214ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.276059 Aug 05 05:19:54.385174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 356/708] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:54.690442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-ff795758-0a5b-4a67-9bdd-5668da4ada59 req-098c0bdb-9052-43c4-8c21-3ed85f6adefb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5caff55-2233-4dbd-8296-3b018d176171", "tag": "fc7ac303-cfb5-47ae-bde0-0a6abea4f8de"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:54.702519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ff795758-0a5b-4a67-9bdd-5668da4ada59 req-098c0bdb-9052-43c4-8c21-3ed85f6adefb service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:54.703012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ff795758-0a5b-4a67-9bdd-5668da4ada59 req-098c0bdb-9052-43c4-8c21-3ed85f6adefb service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:54.703462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ff795758-0a5b-4a67-9bdd-5668da4ada59 req-098c0bdb-9052-43c4-8c21-3ed85f6adefb service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:54.715306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-ff795758-0a5b-4a67-9bdd-5668da4ada59 req-098c0bdb-9052-43c4-8c21-3ed85f6adefb service nova] Creating event network-changed:fc7ac303-cfb5-47ae-bde0-0a6abea4f8de for instance b5caff55-2233-4dbd-8296-3b018d176171 on hv-cinder-81558 Aug 05 05:19:54.720269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-ff795758-0a5b-4a67-9bdd-5668da4ada59 req-098c0bdb-9052-43c4-8c21-3ed85f6adefb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034225 Aug 05 05:19:54.721087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 353/709] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:19:55.405660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:55.406192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:55.413150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:55.413624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:55.414049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:55.414721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:55.415166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:55.415577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:55.560836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:55.573549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8117875b-8635-4ed3-a89d-480b9094e807 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.171628 Aug 05 05:19:55.574458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 357/710] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:55 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:56.598934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:56.599615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:56.602139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:56.607895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:56.608373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:56.608797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:56.609476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:56.609921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:56.610330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:56.613771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=80 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:56.748335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:56.756412 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8371c6f6-22ef-4266-ae72-87538c04a5c9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.162154 Aug 05 05:19:56.756987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 354/711] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:57.777180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:57.777788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:57.780122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:19:57.785443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:57.786283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:57.786708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:57.787381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:57.787852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:57.788261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:57.925519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:57.934173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-99b9960e-820b-4de7-b38b-c4b3301c619a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.160712 Aug 05 05:19:57.936126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 358/712] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:57 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:58.964542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:19:58.965532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:19:58.976102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:58.976579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:58.977002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:58.977673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:58.978114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:58.978523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:59.106808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:19:59.114907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-99cec210-8c2f-41b3-929f-29a9e63a93bd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.156962 Aug 05 05:19:59.115508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 355/713] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:19:58 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:19:59.692543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-275138bd-4674-4b42-90d6-547df0002470 req-bd54e4f8-daa9-46a4-9e14-2bbc3cbd7556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5caff55-2233-4dbd-8296-3b018d176171", "name": "network-vif-plugged", "status": "completed", "tag": "fc7ac303-cfb5-47ae-bde0-0a6abea4f8de"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:19:59.703308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-275138bd-4674-4b42-90d6-547df0002470 req-bd54e4f8-daa9-46a4-9e14-2bbc3cbd7556 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:19:59.703801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-275138bd-4674-4b42-90d6-547df0002470 req-bd54e4f8-daa9-46a4-9e14-2bbc3cbd7556 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:19:59.704230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-275138bd-4674-4b42-90d6-547df0002470 req-bd54e4f8-daa9-46a4-9e14-2bbc3cbd7556 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:19:59.716099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-275138bd-4674-4b42-90d6-547df0002470 req-bd54e4f8-daa9-46a4-9e14-2bbc3cbd7556 service nova] Creating event network-vif-plugged:fc7ac303-cfb5-47ae-bde0-0a6abea4f8de for instance b5caff55-2233-4dbd-8296-3b018d176171 on hv-cinder-81558 Aug 05 05:19:59.721830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-275138bd-4674-4b42-90d6-547df0002470 req-bd54e4f8-daa9-46a4-9e14-2bbc3cbd7556 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032970 Aug 05 05:19:59.723035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 359/714] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:00.140177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:00.141222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:00.150386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:00.150873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:00.151307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:00.152043 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:00.152489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:00.152911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:00.287580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:00.295513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e0d118d0-bc47-4c3e-8755-078123eca952 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.161973 Aug 05 05:20:00.296110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 356/715] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:01.322892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:01.324092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:01.334546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:01.335334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:01.336221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:01.336901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:01.337353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:01.337770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:01.472311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:01.480465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4cd61171-61c7-48be-97c1-8cc1bd8ce23f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1319 microversion: 2.1 time: 0.165630 Aug 05 05:20:01.481035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 360/716] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:01 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:02.505643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:02.506485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:02.510033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:02.510791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:02.517240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:02.517749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:02.518181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:02.518868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:02.519311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:02.519726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:02.649805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:02.657676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e650a4fd-99a8-4e91-9476-8924a03e6d7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1509 microversion: 2.1 time: 0.158691 Aug 05 05:20:02.658243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 357/717] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:08.980073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:08.982254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:08.984274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:08.990328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:08.990869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:08.991331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:08.992050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:08.992518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:08.992939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:09.024741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e6851f97-f10f-4ddb-9a3f-d17f7689f021 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048704 Aug 05 05:20:09.025339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 361/718] 10.222.0.30 () {60 vars in 1343 bytes} [Fri Aug 5 05:20:08 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:09.087962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:09.088478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:09.094964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:09.095452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:09.095920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:09.096607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:09.097060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:09.097479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:09.122874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:20:09.206385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d18cef2e-06e6-4a28-b92b-9babec954a63 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 204 len: 0 microversion: 2.20 time: 0.122009 Aug 05 05:20:09.207239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 358/719] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Aug 5 05:20:09 2022] DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 05:20:09.215827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:09.216439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:09.223017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:09.223504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:09.224020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:09.224769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:09.225248 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:09.225703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:09.366874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:09.375376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:09.376941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:09.378253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d436b976-e87b-44f3-9a39-feef5a575a74 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.166894 Aug 05 05:20:09.378823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 362/720] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:20:09 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:20:10.410234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:10.411693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:10.422561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:10.423417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:10.424190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:10.425326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:10.426102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:10.426521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:10.565274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:10.577655 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:10.579833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:10.581540 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c7fa353d-0ee2-4819-a5d4-d06ed8cca6bf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.178469 Aug 05 05:20:10.582320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 359/721] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:20:10 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:20:11.604935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:11.605535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:11.612641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:11.613095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:11.613548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:11.614232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:11.614673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:11.615084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:11.807798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:11.816407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:11.817919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b89279618557486f9d5b358b654a906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f69b71a364a63850d3008309e0c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:11.819087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e5dc544b-7f7b-4c5a-b59e-dd6466cfdcd9 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 200 len: 1723 microversion: 2.20 time: 0.218118 Aug 05 05:20:11.828991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 363/722] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:20:11 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 05:20:12.117814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-9b44ba61-05ec-480e-b493-8444926afc8e req-ac73c684-86b3-41d5-9517-1c880f44217c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa71ba-15b4-41ed-86e9-b0df6317b0cc", "name": "network-vif-deleted", "tag": "98cad295-2ec9-44a3-9512-556b38096e67"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:20:12.128447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-9b44ba61-05ec-480e-b493-8444926afc8e req-ac73c684-86b3-41d5-9517-1c880f44217c service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:12.129061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-9b44ba61-05ec-480e-b493-8444926afc8e req-ac73c684-86b3-41d5-9517-1c880f44217c service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:12.129575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-9b44ba61-05ec-480e-b493-8444926afc8e req-ac73c684-86b3-41d5-9517-1c880f44217c service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:12.142754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-9b44ba61-05ec-480e-b493-8444926afc8e req-ac73c684-86b3-41d5-9517-1c880f44217c service nova] Creating event network-vif-deleted:98cad295-2ec9-44a3-9512-556b38096e67 for instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc on hv-cinder-81558 Aug 05 05:20:12.148423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-9b44ba61-05ec-480e-b493-8444926afc8e req-ac73c684-86b3-41d5-9517-1c880f44217c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034228 Aug 05 05:20:12.149026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 360/723] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:12.841981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:12.842678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:12.849627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:12.850198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:12.850720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:12.851418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:12.851899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:12.852320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:12.867521 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] HTTP exception thrown: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Request method failure captured: Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc HTTP/1.1 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7Kbw6-0a-UtyiFf37k-6tHNjGVFFHpsJMMwK_nmDb6YRPKPv3Hv-wIx7HMA-O8z4hDf-lGylkWQF2ZFUjXASYWTx79iaYJ_4MHFQN5FbSabVsWzTm0zbth0K106j2dYkKGEOk8ukxJJAM3coYStYROPCySm7Ir4RuIQgs5g2EVUwVwg Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:20:12.871951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e43f69b71a364a63850d3008309e0c68", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: b89279618557486f9d5b358b654a906e Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:12.873523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '67fa71ba-15b4-41ed-86e9-b0df6317b0cc'} Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:12.874301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:12.875560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:12.876783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Returning 404 to user: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:12.876783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f9b1af91-9819-45e4-ae20-77105023bb3a tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 404 len: 111 microversion: 2.20 time: 0.036336 Aug 05 05:20:12.876783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 364/724] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:20:12 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:20:12.884339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bd46c8bd-c00b-4abf-93b9-13af0f9eaf73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '.version_select at 0x7fdc9da3d160>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:12.903999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bd46c8bd-c00b-4abf-93b9-13af0f9eaf73 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046858209" status: 204 len: 0 microversion: 2.20 time: 0.023996 Aug 05 05:20:12.904571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 361/725] 10.222.0.30 () {60 vars in 1262 bytes} [Fri Aug 5 05:20:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046858209 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 05:20:14.705492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:14.706008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:14.712387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:14.712864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:14.713290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:14.713947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:14.714587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:14.715008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:14.729160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] HTTP exception thrown: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Request method failure captured: Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc HTTP/1.1 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7Kbw6-0a-UtyiFf37k-6tHNjGVFFHpsJMMwK_nmDb6YRPKPv3Hv-wIx7HMA-O8z4hDf-lGylkWQF2ZFUjXASYWTx79iaYJ_4MHFQN5FbSabVsWzTm0zbth0K106j2dYkKGEOk8ukxJJAM3coYStYROPCySm7Ir4RuIQgs5g2EVUwVwg Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:20:14.730850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e43f69b71a364a63850d3008309e0c68", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: b89279618557486f9d5b358b654a906e Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.733011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '67fa71ba-15b4-41ed-86e9-b0df6317b0cc'} Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:14.733763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.734965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.736211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Returning 404 to user: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:14.736211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a90f0038-30b0-4544-8e3f-23d40f806f33 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 404 len: 111 microversion: 2.20 time: 0.031054 Aug 05 05:20:14.736211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 365/726] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Aug 5 05:20:14 2022] DELETE /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:20:14.742097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:14.743142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 67fa71ba-15b4-41ed-86e9-b0df6317b0cc] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:14.750077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:14.750731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:14.751306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:14.752356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:14.753022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:14.753587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:14.772296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] HTTP exception thrown: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Request method failure captured: Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc HTTP/1.1 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7Kbw6-0a-UtyiFf37k-6tHNjGVFFHpsJMMwK_nmDb6YRPKPv3Hv-wIx7HMA-O8z4hDf-lGylkWQF2ZFUjXASYWTx79iaYJ_4MHFQN5FbSabVsWzTm0zbth0K106j2dYkKGEOk8ukxJJAM3coYStYROPCySm7Ir4RuIQgs5g2EVUwVwg Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:20:14.774788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e43f69b71a364a63850d3008309e0c68", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: b89279618557486f9d5b358b654a906e Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.776609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '67fa71ba-15b4-41ed-86e9-b0df6317b0cc'} Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:14.777499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. Aug 05 05:20:14.778940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:14.780355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Returning 404 to user: Instance 67fa71ba-15b4-41ed-86e9-b0df6317b0cc could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:14.780355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-36ea22e6-507f-4029-b4d8-961e04758c41 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc" status: 404 len: 111 microversion: 2.20 time: 0.039240 Aug 05 05:20:14.780355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 362/727] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:20:14 2022] GET /compute/v2.1/servers/67fa71ba-15b4-41ed-86e9-b0df6317b0cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:20:15.925459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:15.925964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:15.932985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:15.933472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:15.933902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:15.934601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:15.935050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:15.935472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:15.949724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] HTTP exception thrown: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Request method failure captured: Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 HTTP/1.1 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7Kbw6-0a-UtyiFf37k-6tHNjGVFFHpsJMMwK_nmDb6YRPKPv3Hv-wIx7HMA-O8z4hDf-lGylkWQF2ZFUjXASYWTx79iaYJ_4MHFQN5FbSabVsWzTm0zbth0K106j2dYkKGEOk8ukxJJAM3coYStYROPCySm7Ir4RuIQgs5g2EVUwVwg Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:20:15.951281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e43f69b71a364a63850d3008309e0c68", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: b89279618557486f9d5b358b654a906e Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.952893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '5edf8301-151e-4713-83c9-fe12e7517fe0'} Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:15.953635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.954867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.956111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Returning 404 to user: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:15.956111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e7151db6-b218-4c3b-86b2-4e308493a3e4 tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 404 len: 111 microversion: 2.20 time: 0.031258 Aug 05 05:20:15.956111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 366/728] 10.222.0.30 () {60 vars in 1280 bytes} [Fri Aug 5 05:20:15 2022] DELETE /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:20:15.961497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:15.962121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] [instance: 5edf8301-151e-4713-83c9-fe12e7517fe0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:15.968992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:15.969477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:15.969904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:15.970581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:15.971025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:15.971437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:15.985107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] HTTP exception thrown: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Request method failure captured: Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 HTTP/1.1 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7Kbw6-0a-UtyiFf37k-6tHNjGVFFHpsJMMwK_nmDb6YRPKPv3Hv-wIx7HMA-O8z4hDf-lGylkWQF2ZFUjXASYWTx79iaYJ_4MHFQN5FbSabVsWzTm0zbth0K106j2dYkKGEOk8ukxJJAM3coYStYROPCySm7Ir4RuIQgs5g2EVUwVwg Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:20:15.986650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e43f69b71a364a63850d3008309e0c68", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e43f69b71a364a63850d3008309e0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e43f69b71a364a63850d3008309e0c68 Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-199150712 Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: b89279618557486f9d5b358b654a906e Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeShelveTestJSON-199150712-project Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.988347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '5edf8301-151e-4713-83c9-fe12e7517fe0'} Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:15.989179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. Aug 05 05:20:15.990558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:15.991967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] Returning 404 to user: Instance 5edf8301-151e-4713-83c9-fe12e7517fe0 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:15.991967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e5c56fa5-3227-446a-b240-6e5409c52ddf tempest-AttachVolumeShelveTestJSON-199150712 tempest-AttachVolumeShelveTestJSON-199150712-project] 10.222.0.30 "GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0" status: 404 len: 111 microversion: 2.20 time: 0.030514 Aug 05 05:20:15.991967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 363/729] 10.222.0.30 () {60 vars in 1277 bytes} [Fri Aug 5 05:20:15 2022] GET /compute/v2.1/servers/5edf8301-151e-4713-83c9-fe12e7517fe0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 05:20:17.921240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33819fd0-9ccb-47f7-b771-63faa6e87833", "device": "/dev/sdb"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:20:17.924314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:17.931180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:17.931924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:17.932353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:17.933059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:17.933655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:17.934223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:18.252865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bcbbd179-d694-49b6-8f42-0bb113653ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "POST /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335734 Aug 05 05:20:18.253482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 367/730] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:20:17 2022] POST /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:21.162938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-20ee0d52-0a31-42ad-9e7e-ba70e622e606 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Action: 'create', calling method: .version_select at 0x7fdc9db6fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-297677328"}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:20:21.458752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-20ee0d52-0a31-42ad-9e7e-ba70e622e606 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.413791 Aug 05 05:20:21.459381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 364/731] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Aug 5 05:20:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 05:20:21.473429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-30a08168-3b34-4696-97af-1c95520ec602 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da86160>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:21.527439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-30a08168-3b34-4696-97af-1c95520ec602 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 200 len: 344 microversion: 2.1 time: 0.059388 Aug 05 05:20:21.528144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 368/732] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:21 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:22.544195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-402e6cee-3579-4b0e-b133-965fb2dd1495 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da2e8b0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:22.592138 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-402e6cee-3579-4b0e-b133-965fb2dd1495 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 200 len: 345 microversion: 2.1 time: 0.053621 Aug 05 05:20:22.592735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 365/733] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:22 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:22.605830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-839f9450-b02b-4070-a9af-1765c147e32d tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Action: 'create', calling method: .version_select at 0x7fdc9d9e20d0>, body: {"snapshot": {"volume_id": "7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1088154705"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:20:22.764526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-839f9450-b02b-4070-a9af-1765c147e32d tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.163160 Aug 05 05:20:22.765192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 369/734] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Aug 5 05:20:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:22.776315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-93bc3b6a-e831-4620-a116-69333e8560de tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9dacac10>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:22.806631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-93bc3b6a-e831-4620-a116-69333e8560de tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 200 len: 287 microversion: 2.1 time: 0.034504 Aug 05 05:20:22.807338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 366/735] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:22 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:22.819216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6b67743a-d753-47cb-99b7-9466f299e2aa tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9d9e2670>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:22.849267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6b67743a-d753-47cb-99b7-9466f299e2aa tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033977 Aug 05 05:20:22.849827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 370/736] 10.222.0.30 () {58 vars in 1140 bytes} [Fri Aug 5 05:20:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:22.860975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-410f3730-69c7-4603-9fef-e36503daf910 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9db6f3a0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:22.890339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-410f3730-69c7-4603-9fef-e36503daf910 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 200 len: 287 microversion: 2.1 time: 0.033171 Aug 05 05:20:22.890909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 367/737] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:22 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:23.904363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d992c22c-0463-4ba3-88cf-ecf8cf685e2d tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da0d160>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:23.936431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d992c22c-0463-4ba3-88cf-ecf8cf685e2d tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 200 len: 287 microversion: 2.1 time: 0.036711 Aug 05 05:20:23.937134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 371/738] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:23 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:24.955488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-969d1ecd-f78f-4009-971d-ad1e2f475a6d tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da9d430>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:24.990319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-969d1ecd-f78f-4009-971d-ad1e2f475a6d tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 200 len: 287 microversion: 2.1 time: 0.042179 Aug 05 05:20:24.990867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 368/739] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:24 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:26.005945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ec8ba311-2e9d-4d99-adf5-150af5d13586 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9d9c5040>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:26.038223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ec8ba311-2e9d-4d99-adf5-150af5d13586 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 200 len: 288 microversion: 2.1 time: 0.038188 Aug 05 05:20:26.038778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 372/740] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:25 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:26.047593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:26.048565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:26.053428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7fbdb3a6-a598-42f6-94ff-17fe43bb6a3f tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9dad8a60>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:26.112991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7fbdb3a6-a598-42f6-94ff-17fe43bb6a3f tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 202 len: 0 microversion: 2.1 time: 0.066589 Aug 05 05:20:26.113591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 369/741] 10.222.0.30 () {58 vars in 1254 bytes} [Fri Aug 5 05:20:26 2022] DELETE /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:20:26.121776 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-db495eb8-9695-459f-8904-484968f85eed tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9dad1c10>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:26.150678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-db495eb8-9695-459f-8904-484968f85eed tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 200 len: 287 microversion: 2.1 time: 0.032703 Aug 05 05:20:26.155742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 373/742] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:26 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:27.164023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8c21528c-c462-4b69-b18f-c9c53c2dc60b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9daca160>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:27.189791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-8c21528c-c462-4b69-b18f-c9c53c2dc60b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] HTTP exception thrown: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8c21528c-c462-4b69-b18f-c9c53c2dc60b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Request method failure captured: Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b HTTP/1.1 Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KiUX7arnjRMlya2CLohDGTCT6Su7sBDmAGd0XAjFXeP-SXhFpPM30kbSOmER0MYfIn-I4IuTfVvwOc-o1BKQv98UkZFx1Y7uLN9eF_9jPK-b4v6Ruvr7pxKvH0E_BMg6HnAOXzsZg7CWsCuXSJjpPefqn6WUqR9nLJvwJV4RedtK0o Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:20:27.192063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ba6b61b39e04bf98627fe6a470ba184", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 7127bedba9fa462fa068c407fe69221a Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'de0e2922-4908-4716-bcf5-a2fb2c1d0b0b'} Aug 05 05:20:27.193544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. (HTTP 404) (Request-ID: req-21b15abb-2f1d-4ac7-abc7-36dfce0d1508) Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.194533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:20:27.195967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 05:20:27.197491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8c21528c-c462-4b69-b18f-c9c53c2dc60b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Returning 404 to user: Snapshot de0e2922-4908-4716-bcf5-a2fb2c1d0b0b could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:27.199119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8c21528c-c462-4b69-b18f-c9c53c2dc60b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b" status: 404 len: 111 microversion: 2.1 time: 0.034231 Aug 05 05:20:27.200096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 370/743] 10.222.0.30 () {58 vars in 1251 bytes} [Fri Aug 5 05:20:27 2022] GET /compute/v2.1/os-snapshots/de0e2922-4908-4716-bcf5-a2fb2c1d0b0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:20:27.202716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-406a6b20-ded5-46dc-a99a-a61b9010257e tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da86160>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:27.266846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-406a6b20-ded5-46dc-a99a-a61b9010257e tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 202 len: 0 microversion: 2.1 time: 0.068402 Aug 05 05:20:27.267449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 374/744] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:20:27 2022] DELETE /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 05:20:27.278132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7995a290-bed7-4b72-a77f-614c2bbfd414 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da2e3a0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:27.328993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7995a290-bed7-4b72-a77f-614c2bbfd414 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 200 len: 344 microversion: 2.1 time: 0.055006 Aug 05 05:20:27.329569 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 371/745] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:27 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:28.344228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=19 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:28.346374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:28.355192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1b4b9b02-ecae-48f9-bba2-e850b5ab5fa8 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9d9e2e50>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:28.402971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1b4b9b02-ecae-48f9-bba2-e850b5ab5fa8 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 200 len: 344 microversion: 2.1 time: 0.060363 Aug 05 05:20:28.403522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 375/746] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:28 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:28.665895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:28.666562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:28.673006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.673487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.673914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.674597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.675042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.675447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.698969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-881ab6a2-7e18-4c36-8c06-0d08ba069361 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/ips" status: 200 len: 149 microversion: 2.1 time: 0.039438 Aug 05 05:20:28.699527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 372/747] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:20:28 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:28.711346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b37617a0-7259-4090-8a5e-af31cc2d4c2f"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:20:28.713940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:28.720846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.721333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.721771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.722555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.723013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.723446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.808830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Invalid volume: volume b37617a0-7259-4090-8a5e-af31cc2d4c2f is already attached to instances: e365c429-240d-4397-a002-eae5c51453cf Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: POST /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/os-volume_attachments HTTP/1.1 Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 74 Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:20:28.810605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {"volumeAttachment": {"volumeId": "b37617a0-7259-4090-8a5e-af31cc2d4c2f"}} Aug 05 05:20:28.812290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Invalid volume: volume b37617a0-7259-4090-8a5e-af31cc2d4c2f is already attached to instances: e365c429-240d-4397-a002-eae5c51453cf Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'server_id': '3ac3edaa-53ee-49c7-b154-c73b0d93e41f', 'body': {'volumeAttachment': {'volumeId': 'b37617a0-7259-4090-8a5e-af31cc2d4c2f'}}} Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b37617a0-7259-4090-8a5e-af31cc2d4c2f is already attached to instances: e365c429-240d-4397-a002-eae5c51453cf Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:28.813210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b37617a0-7259-4090-8a5e-af31cc2d4c2f is already attached to instances: e365c429-240d-4397-a002-eae5c51453cf Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:28.814431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b37617a0-7259-4090-8a5e-af31cc2d4c2f is already attached to instances: e365c429-240d-4397-a002-eae5c51453cf Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 400 to user: Invalid volume: volume b37617a0-7259-4090-8a5e-af31cc2d4c2f is already attached to instances: e365c429-240d-4397-a002-eae5c51453cf {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d5ac0dc7-c9b7-4c93-8edb-4d8df31cc0ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104858 Aug 05 05:20:28.815644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 376/748] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:20:28 2022] POST /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:20:28.822099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:28.822683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:28.828992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.829503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.829924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.830601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.831043 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.831459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.856070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:20:28.936031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9d62fb19-74d9-4420-8c3b-ff6e42e07338 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 204 len: 0 microversion: 2.1 time: 0.117479 Aug 05 05:20:28.936482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 373/749] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:20:28 2022] DELETE /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:20:28.945495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:28.946107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:28.952761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.953241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.953667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:28.954349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:28.954789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:28.955202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:29.099663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:29.107737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bfb61ebc-85ab-476d-bff7-378123eeeda3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1680 microversion: 2.1 time: 0.166673 Aug 05 05:20:29.108283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 377/750] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:28 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:20:29.422313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5a5cb78e-d73d-4d77-b7ca-fbb045f72952 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da2e670>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:29.473822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5a5cb78e-d73d-4d77-b7ca-fbb045f72952 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 200 len: 344 microversion: 2.1 time: 0.058445 Aug 05 05:20:29.474381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 374/751] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:29 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:30.133601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:30.134446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:30.145201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:30.145989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:30.146693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:30.147848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:30.148583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:30.149275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:30.283021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:30.291288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fc7e4f57-7616-43ec-ae2f-92ebd0b827d1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1680 microversion: 2.1 time: 0.164464 Aug 05 05:20:30.291869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 378/752] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:30 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:30.492605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-705ceb4e-93c1-409d-b9b4-12b9bd991d5b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9dacaee0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:30.528089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-705ceb4e-93c1-409d-b9b4-12b9bd991d5b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] HTTP exception thrown: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-705ceb4e-93c1-409d-b9b4-12b9bd991d5b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Request method failure captured: Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc HTTP/1.1 Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KiUX7arnjRMlya2CLohDGTCT6Su7sBDmAGd0XAjFXeP-SXhFpPM30kbSOmER0MYfIn-I4IuTfVvwOc-o1BKQv98UkZFx1Y7uLN9eF_9jPK-b4v6Ruvr7pxKvH0E_BMg6HnAOXzsZg7CWsCuXSJjpPefqn6WUqR9nLJvwJV4RedtK0o Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:20:30.530209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ba6b61b39e04bf98627fe6a470ba184", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 7127bedba9fa462fa068c407fe69221a Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc'} Aug 05 05:20:30.531753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. (HTTP 404) (Request-ID: req-3506e84a-433a-45a2-8a1d-1e25fb3c2d5f) Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.532793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:20:30.534115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 05:20:30.535717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-705ceb4e-93c1-409d-b9b4-12b9bd991d5b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Returning 404 to user: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-705ceb4e-93c1-409d-b9b4-12b9bd991d5b tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 404 len: 109 microversion: 2.1 time: 0.046283 Aug 05 05:20:30.537130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 375/753] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:30 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:20:30.546993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3e3402e0-87ec-4ce6-8eda-db23dcd90c95 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9d9bca60>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:30.574722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-3e3402e0-87ec-4ce6-8eda-db23dcd90c95 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] HTTP exception thrown: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3e3402e0-87ec-4ce6-8eda-db23dcd90c95 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Request method failure captured: Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc HTTP/1.1 Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KiUX7arnjRMlya2CLohDGTCT6Su7sBDmAGd0XAjFXeP-SXhFpPM30kbSOmER0MYfIn-I4IuTfVvwOc-o1BKQv98UkZFx1Y7uLN9eF_9jPK-b4v6Ruvr7pxKvH0E_BMg6HnAOXzsZg7CWsCuXSJjpPefqn6WUqR9nLJvwJV4RedtK0o Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:20:30.578073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ba6b61b39e04bf98627fe6a470ba184", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 7127bedba9fa462fa068c407fe69221a Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc'} Aug 05 05:20:30.579621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. (HTTP 404) (Request-ID: req-918a8d8d-25b2-489e-a77d-2b8a337cc13c) Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.580732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 05:20:30.582134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 05:20:30.583442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3e3402e0-87ec-4ce6-8eda-db23dcd90c95 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Returning 404 to user: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3e3402e0-87ec-4ce6-8eda-db23dcd90c95 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 404 len: 109 microversion: 2.1 time: 0.036376 Aug 05 05:20:30.584833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 379/754] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:20:30 2022] DELETE /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:20:30.589067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7364a3aa-b1c8-46cd-9a12-a781188a9013 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Calling method '.version_select at 0x7fdc9da2eaf0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:30.620411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-7364a3aa-b1c8-46cd-9a12-a781188a9013 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] HTTP exception thrown: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7364a3aa-b1c8-46cd-9a12-a781188a9013 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Request method failure captured: Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc HTTP/1.1 Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KiUX7arnjRMlya2CLohDGTCT6Su7sBDmAGd0XAjFXeP-SXhFpPM30kbSOmER0MYfIn-I4IuTfVvwOc-o1BKQv98UkZFx1Y7uLN9eF_9jPK-b4v6Ruvr7pxKvH0E_BMg6HnAOXzsZg7CWsCuXSJjpPefqn6WUqR9nLJvwJV4RedtK0o Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:20:30.622340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ba6b61b39e04bf98627fe6a470ba184", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ba6b61b39e04bf98627fe6a470ba184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: 7ba6b61b39e04bf98627fe6a470ba184 Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1961686878 Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 7127bedba9fa462fa068c407fe69221a Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1961686878-project Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc'} Aug 05 05:20:30.623816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. (HTTP 404) (Request-ID: req-ddaefc47-8428-48f4-81b0-21e2bddf9d6c) Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.624774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:20:30.626137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 05:20:30.627426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7364a3aa-b1c8-46cd-9a12-a781188a9013 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] Returning 404 to user: Volume 7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7364a3aa-b1c8-46cd-9a12-a781188a9013 tempest-VolumesSnapshotsTestJSON-1961686878 tempest-VolumesSnapshotsTestJSON-1961686878-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc" status: 404 len: 109 microversion: 2.1 time: 0.039690 Aug 05 05:20:30.628779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 376/755] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:20:30 2022] GET /compute/v2.1/os-volumes/7a3bcf1d-ee09-4718-94f0-bfd60a6d34cc => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:20:31.314980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:31.316593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:31.326544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:31.327026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:31.327665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:31.328426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:31.329186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:31.329607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:31.474185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:31.481724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-59f06b35-fb9c-4f0b-9906-722a93d27fa2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1680 microversion: 2.1 time: 0.172153 Aug 05 05:20:31.482342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 380/756] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:31 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:32.442230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-0f12a71a-4f90-4bd0-b891-59f58002749c req-c1df8e03-4b77-4d8f-a960-a782d3f5683f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac3edaa-53ee-49c7-b154-c73b0d93e41f", "name": "network-vif-deleted", "tag": "25f9b321-a1c5-45c6-a82e-7c00f737ce09"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:20:32.453391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f12a71a-4f90-4bd0-b891-59f58002749c req-c1df8e03-4b77-4d8f-a960-a782d3f5683f service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:32.453873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f12a71a-4f90-4bd0-b891-59f58002749c req-c1df8e03-4b77-4d8f-a960-a782d3f5683f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:32.454298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-0f12a71a-4f90-4bd0-b891-59f58002749c req-c1df8e03-4b77-4d8f-a960-a782d3f5683f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:32.465021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-0f12a71a-4f90-4bd0-b891-59f58002749c req-c1df8e03-4b77-4d8f-a960-a782d3f5683f service nova] Creating event network-vif-deleted:25f9b321-a1c5-45c6-a82e-7c00f737ce09 for instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f on hv-cinder-81558 Aug 05 05:20:32.470120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-0f12a71a-4f90-4bd0-b891-59f58002749c req-c1df8e03-4b77-4d8f-a960-a782d3f5683f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Aug 05 05:20:32.471078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 377/757] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:32.502762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:32.504105 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:32.511146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:32.511733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:32.512273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:32.513055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:32.513632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:32.514140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:32.580430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:32.588246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-33df4fa1-bdb2-48f7-a181-7c95a72723d7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1613 microversion: 2.1 time: 0.089477 Aug 05 05:20:32.589211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 381/758] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:32 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:20:33.616210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:33.617345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:33.627701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:33.628545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:33.629266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:33.630370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:33.631105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:33.631859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:33.695584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:33.703260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e4c64478-a7cd-4a91-b216-492cc5c02aee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1326 microversion: 2.1 time: 0.095168 Aug 05 05:20:33.703802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 378/759] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:33 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:34.730365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:34.731723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:34.743513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:34.744488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:34.745347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:34.746026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:34.746475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:34.746892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:34.779897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:34.780403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:34.781054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:34.781568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lazy-loading 'fault' on Instance uuid 3ac3edaa-53ee-49c7-b154-c73b0d93e41f {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:20:34.826279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:20:34.834508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-64762e65-3d95-4ae1-b66c-13bf9269588f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 200 len: 1331 microversion: 2.1 time: 0.112551 Aug 05 05:20:34.835755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 382/760] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:34 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:20:35.857822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:35.858482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:35.864645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:35.865127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:35.865556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:35.866272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:35.866715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:35.867128 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:35.883003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f HTTP/1.1 Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:20:35.884654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:20:35.886230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '3ac3edaa-53ee-49c7-b154-c73b0d93e41f'} Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:20:35.887111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:20:35.888558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:20:35.889865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:20:35.889865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7f3b0e59-3d19-4a18-9aa6-5df83abb5903 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 404 len: 111 microversion: 2.1 time: 0.032338 Aug 05 05:20:35.889865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 379/761] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:20:35 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:20:35.895043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d5e6738c-f0b8-44ab-a29c-cc924f8fde7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '.version_select at 0x7fdc9d9d4b80>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:35.917408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d5e6738c-f0b8-44ab-a29c-cc924f8fde7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255391015" status: 202 len: 0 microversion: 2.1 time: 0.026206 Aug 05 05:20:35.917957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 383/762] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Aug 5 05:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255391015 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:20:36.602095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:36.602757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:36.609549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:36.610029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:36.610456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:36.611135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:36.611607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:36.612028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:36.701038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lazy-loading 'services' on Instance uuid e365c429-240d-4397-a002-eae5c51453cf {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:20:36.774981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ed52e49c-02a6-46b2-a40d-73ae2e15607c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments/b37617a0-7259-4090-8a5e-af31cc2d4c2f" status: 202 len: 0 microversion: 2.1 time: 0.179062 Aug 05 05:20:36.775570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 380/763] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:20:36 2022] DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments/b37617a0-7259-4090-8a5e-af31cc2d4c2f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:20:36.784814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:36.787438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:36.794721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:36.795249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:36.795663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:36.796385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:36.796922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:36.797374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:36.828198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-455d0874-c614-43b1-a205-e3f055983c96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048109 Aug 05 05:20:36.828748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 384/764] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:37.847303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:37.850577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:37.859690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:37.860422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:37.861032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:37.861994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:37.862603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:37.863367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:37.895435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-89519629-5db8-44bb-9be4-51db2ea4b8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057650 Aug 05 05:20:37.895990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 381/765] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:38.907927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:38.911045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:38.919628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:38.919628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:38.919628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:38.919954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:38.920309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:38.920852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:38.950339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-05e3bebe-d98e-4e6f-9dc7-31a2529e1101 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Aug 05 05:20:38.951148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 385/766] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:39.963184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:39.965529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:39.971714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:39.972233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:39.972668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:39.973352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:39.973794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:39.974209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:40.004348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6bad35da-1898-4e80-83ec-d46d352344a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Aug 05 05:20:40.004898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 382/767] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:41.016849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:41.019052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:41.025935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:41.026533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:41.026968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:41.028149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:41.028804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:41.029305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:41.060911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-386706de-94a4-487a-b638-fdd6c18f5077 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048047 Aug 05 05:20:41.061458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 386/768] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:42.072798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:42.075026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:42.081907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:42.082393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:42.082853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:42.083500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:42.083980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:42.084399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:42.113679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-93b80070-eaf6-4b0c-9085-53d23110413b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Aug 05 05:20:42.114234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 383/769] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:43.130153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:43.133642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:43.144679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:43.145481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:43.146184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:43.147300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:43.148199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:43.148890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:43.179449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-24024155-1bb6-43cb-a962-f20bd4b91112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056011 Aug 05 05:20:43.180028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 387/770] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:44.195277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:44.198863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:44.206827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:44.207309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:44.207799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:44.208517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:44.208972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:44.209389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:44.238731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c6e5d0b2-1f59-47fa-830a-17a66dac0f5f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050098 Aug 05 05:20:44.239269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 384/771] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:45.256186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:45.259500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:45.270524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:45.271319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:45.272083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:45.273204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:45.273949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:45.274606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:45.306224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e4062448-e16a-4435-b553-d33f9d990abb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057748 Aug 05 05:20:45.306788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 388/772] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:46.322964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:46.326396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:46.333415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:46.333903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:46.334332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:46.335015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:46.335463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:46.335917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:46.366712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ad1b2f49-fe34-4c5f-94cc-1ea0551b9e75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050613 Aug 05 05:20:46.367291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 385/773] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:47.383725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:47.387106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:47.397916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:47.398725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:47.399449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:47.400639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:47.401395 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:47.402115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:47.432974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0e3bf24b-7082-4048-bcee-34cbb3864232 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056100 Aug 05 05:20:47.433525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 389/774] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:48.449922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:48.452633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:48.459403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:48.459928 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:48.460362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:48.461054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:48.461473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:48.461922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:48.491609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4f138e7c-435e-4bbc-beb0-ebfee57aa660 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Aug 05 05:20:48.492195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 386/775] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:49.508739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:49.512082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:49.519573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:49.520106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:49.520576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:49.521267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:49.521715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:49.522139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:49.552100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-be5304c3-917f-4ad6-b738-6eebd180aab3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050349 Aug 05 05:20:49.552656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 390/776] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:50.569734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:50.573101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:50.584256 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:50.585060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:50.585778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:50.586932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:50.587684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:50.588437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:50.618600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5c1751d9-22b8-470c-ba2d-66a97cf1b8ca tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056358 Aug 05 05:20:50.619147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 387/777] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:51.635161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:51.638677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:51.645254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:51.645712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:51.646143 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:51.646828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:51.647276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:51.647694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:51.677452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-51e9b37c-6020-4451-9ad6-6c8bde87b93a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049235 Aug 05 05:20:51.677998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 391/778] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:52.694351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:52.697843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:52.708921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:52.709734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:52.710435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:52.711548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:52.712327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:52.712983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:52.743826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-929252f5-b7ed-4ac7-acd2-17c476bda5d4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056240 Aug 05 05:20:52.744390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 388/779] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:53.759565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:53.763089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:53.770326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:53.770802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:53.771256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:53.771998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:53.772445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:53.772880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:53.803170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dab183b8-252b-45f2-8801-51169528c769 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Aug 05 05:20:53.803719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 392/780] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:54.821777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:54.825287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:54.836473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:54.837278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:54.837993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:54.839127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:54.839885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:54.840636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:54.871063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7c36be57-ec75-42ed-8f9f-3d94de91aee4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055921 Aug 05 05:20:54.871586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 389/781] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:55.888634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:55.892170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:55.902865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:55.903654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:55.904445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:55.905132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:55.905572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:55.905987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:55.935668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-111577d9-e8b7-460e-8cb4-ac2375b479c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053941 Aug 05 05:20:55.936262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 393/782] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:56.947787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:56.949941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:56.952459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:56.958275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:56.958759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:56.959195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:56.959917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:56.960373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:56.960794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:56.963903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:56.994272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-210018cb-2e9f-4140-95f8-603a4c5afc45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050538 Aug 05 05:20:56.994824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 390/783] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:58.010869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:58.014445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:58.021557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:58.022045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:58.022480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:58.023170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:58.023615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:58.024080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:58.027740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:20:58.053910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-642d5d64-f0ad-4367-b702-91d69d813c58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049863 Aug 05 05:20:58.054460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 394/784] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:20:59.070856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:20:59.074338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:20:59.085562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:59.086348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:59.087054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:59.088336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:20:59.089082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:20:59.089813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:20:59.120539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e7e832a9-4b25-4090-8752-83a042ac2c6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056834 Aug 05 05:20:59.121097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 391/785] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:20:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:00.137277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:00.141113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:00.143506 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:00.149295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:00.149774 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:00.150194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:00.150897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:00.151338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:00.151747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:00.182682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a81850ea-226c-4772-b6c0-167962737f66 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052140 Aug 05 05:21:00.183255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 395/786] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:01.194738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:01.197461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:01.207324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:01.208103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:01.208628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:01.209644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:01.210289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:01.210759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:01.241773 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-58dcf741-df5c-49bf-9943-6e8091dea11e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050993 Aug 05 05:21:01.242310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 392/787] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:02.254399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:02.256558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:02.263439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:02.263945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:02.264376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:02.265156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:02.265598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:02.266010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:02.296695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a0afea37-fce0-4285-afeb-d5326b390689 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046238 Aug 05 05:21:02.297255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 396/788] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:03.309333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:03.311493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:03.318478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:03.318965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:03.319399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:03.320156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:03.320615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:03.321033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:03.350473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d8448838-ef00-4790-a43c-fd4f786aaa8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Aug 05 05:21:03.351010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 393/789] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:04.367037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:04.370568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:04.379132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:04.379607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:04.380080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:04.380758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:04.381203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:04.381615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:04.413725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b90f1dea-2326-48b7-b96d-182a148836a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053205 Aug 05 05:21:04.414283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 397/790] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:05.427981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:05.430989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:05.440674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:05.441365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:05.441991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:05.442977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:05.443626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:05.444285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:05.475947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7704bfb2-d086-4327-80b8-5bcdb9487251 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053715 Aug 05 05:21:05.476481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 394/791] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:06.489494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:06.491733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:06.498917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:06.499532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:06.500010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:06.500701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:06.501169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:06.501590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:06.530592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-57201481-7d1b-4c88-b3e0-10b5c2a3cb10 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Aug 05 05:21:06.531145 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 398/792] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:07.547290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:07.550049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:07.559050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:07.559693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:07.560324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:07.561232 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:07.561827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:07.562379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:07.595164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-08f75077-aa4b-4471-9712-2dde35ad7344 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054667 Aug 05 05:21:07.595710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 395/793] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:08.610993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:08.613320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:08.620877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:08.621417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:08.621923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:08.622693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:08.623209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:08.623686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:08.653986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-79d15aab-3094-4f8d-be19-b25dbf515fad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048837 Aug 05 05:21:08.654549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 399/794] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:09.671360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:09.674854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:09.685152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:09.685952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:09.686673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:09.687613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:09.688092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:09.688509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:09.717701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8a715b02-7cd8-41cd-b270-97d10a5f03cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053030 Aug 05 05:21:09.718173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 396/795] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:10.734315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:10.736526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:10.743598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:10.744115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:10.744546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:10.745231 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:10.745682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:10.746101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:10.776741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0ab35c32-191c-4aa7-85c8-452bfd370b89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 Aug 05 05:21:10.777296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 400/796] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:11.793573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:11.796996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:11.808761 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:11.809564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:11.810304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:11.811440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:11.812226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:11.812646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:11.842133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d6a833d8-a15f-4649-b39e-24fbad34929f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055818 Aug 05 05:21:11.842680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 397/797] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:12.859454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:12.861644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:12.869065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:12.869567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:12.869974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:12.870710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:12.871159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:12.871759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:12.903073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-25146683-9210-498c-a84a-361d241c10e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050380 Aug 05 05:21:12.903642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 401/798] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:13.920114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:13.923638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:13.934540 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:13.935338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:13.936099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:13.937263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:13.937893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:13.938304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:13.967423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-828272cc-61cc-4412-884a-865cdce243a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054095 Aug 05 05:21:13.967994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 398/799] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:14.984524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:14.986673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:14.993682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:14.994162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:14.994616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:14.995279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:14.995719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:14.996175 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:15.025849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-59eebabf-f320-4ea8-86fe-cf1d802a3f46 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048081 Aug 05 05:21:15.026410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 402/800] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:16.038398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:16.040642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:16.047574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:16.048095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:16.048534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:16.049226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:16.049674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:16.050092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:16.079672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-99044b39-0cfe-41c7-b845-3d7d5fb0855a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Aug 05 05:21:16.080608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 399/801] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:17.096080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:17.098294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:17.105404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:17.105893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:17.106327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:17.107016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:17.107523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:17.108337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:17.138261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8168df4a-d3dc-491b-9721-8d758e22626f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047817 Aug 05 05:21:17.139129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 403/802] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:18.155270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:18.158763 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:18.169803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:18.170657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:18.171424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:18.172378 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:18.172825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:18.173243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:18.202527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7bf116b6-de73-409d-a475-5450a664ed51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054063 Aug 05 05:21:18.203161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 400/803] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:19.221519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:19.225007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:19.236468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:19.237256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:19.237962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:19.239086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:19.239838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:19.240564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:19.274000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4774a02e-1ca2-403d-8c44-ec7b332c31e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059390 Aug 05 05:21:19.274553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 404/804] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:20.291172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:20.294691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:20.302912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:20.303396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:20.303863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:20.304544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:20.304993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:20.305415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:20.336196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f40b17ae-ea42-4322-9709-03c5e447c1af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052138 Aug 05 05:21:20.336748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 401/805] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:21.353052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:21.356529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:21.366854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:21.367644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:21.368415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:21.369533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:21.370271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:21.370972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:21.403437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-79f0b559-3c56-4b5a-8c78-2ac19b9f64c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057061 Aug 05 05:21:21.404042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 405/806] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:22.420679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:22.423448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:22.434559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:22.435369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:22.436132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:22.437264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:22.438002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:22.438696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:22.468541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0cdbe31b-7a9a-43b2-9f24-48dd6f1f3cb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055250 Aug 05 05:21:22.469084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 402/807] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:23.485047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:23.487760 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:23.494633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:23.495118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:23.495555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:23.496285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:23.496742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:23.497161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:23.526783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b76b363a-7f57-4ae0-ab65-3644ced80ad8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048544 Aug 05 05:21:23.527337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 406/808] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:24.539556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:24.541748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:24.548558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:24.549038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:24.549460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:24.550145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:24.550608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:24.551050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:24.580278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5b6e8f14-38a0-445b-b8d4-3e314a0b1757 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Aug 05 05:21:24.580739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 403/809] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:25.592751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:25.594938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:25.601876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:25.602355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:25.602788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:25.603483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:25.603961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:25.604382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:25.633888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ea3842eb-0f30-4e11-9652-343297a607d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Aug 05 05:21:25.634448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 407/810] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:26.646500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:26.648797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:26.655735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:26.656289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:26.656722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:26.657419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:26.657926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:26.658338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:26.688595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5fc11009-f6b2-42be-b800-7419aeaf320b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Aug 05 05:21:26.689166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 404/811] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:27.701505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:27.703735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:27.710577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:27.711053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:27.711485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:27.712225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:27.712666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:27.713077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:27.743608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e48bd6f9-f6ae-4b4c-b396-8fc6185b7abe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046153 Aug 05 05:21:27.744157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 408/812] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:28.756957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:28.759404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:28.761840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:28.768327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:28.768809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:28.769263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:28.769948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:28.771128 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:28.771603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:28.774861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:28.803602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4def1f3c-42c3-4165-9a06-dc1920eed453 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051311 Aug 05 05:21:28.804186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 405/813] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:29.820956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:29.824482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:29.835545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:29.836073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:29.836511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:29.837209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:29.837663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:29.838094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:29.840484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=89 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:29.868683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-13d23ee2-a303-402a-862f-bb86db1de78a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055228 Aug 05 05:21:29.869517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 409/814] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:30.886724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:30.890210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:30.900044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:30.900532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:30.900958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:30.901634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:30.902104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:30.902495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:30.932093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b7b93ff9-0dec-48e0-bdd1-c20c4ab69789 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053113 Aug 05 05:21:30.932630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 406/815] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:31.949461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:31.952987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:31.956625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:21:31.965249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:31.966039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:31.966739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:31.967892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:31.968622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:31.969316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:32.001893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b7a71469-bf15-4508-879e-bdf2bf74d513 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059297 Aug 05 05:21:32.002461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 410/816] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:33.018392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:33.022061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:33.029628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:33.030108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:33.030528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:33.031209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:33.031650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:33.032090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:33.063052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8e53a772-876c-46b7-939f-a0a269b4a8a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051394 Aug 05 05:21:33.063610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 407/817] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:34.078333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:34.081769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:34.092757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:34.093542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:34.094253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:34.095448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:34.096229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:34.096924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:34.128890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-41e9ecfd-aee4-457b-8ecf-1437a971a283 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057441 Aug 05 05:21:34.129446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 411/818] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:35.146246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:35.149447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:35.156665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:35.157176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:35.157627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:35.158346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:35.158812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:35.159263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:35.190473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-be620476-57f7-4b3e-a915-665cec4d9ca1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051233 Aug 05 05:21:35.191007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 408/819] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:36.207598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:36.211117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:36.222370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:36.223158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:36.223885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:36.225035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:36.225766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:36.226452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:36.255632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-af7ba02f-64fc-451c-b104-6edf3753647d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054806 Aug 05 05:21:36.256198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 412/820] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:37.268600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:37.270767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:37.277828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:37.278321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:37.278763 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:37.279450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:37.279946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:37.280367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:37.311331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7d124779-87dd-4888-9fab-25336b714fda tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046789 Aug 05 05:21:37.311918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 409/821] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:38.332129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:38.335801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:38.343705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:38.344276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:38.344712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:38.345405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:38.345852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:38.346277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:38.375908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dabd54f7-3d69-476d-af5a-fe51b3ec29fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050764 Aug 05 05:21:38.376482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 413/822] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:39.392305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:39.395620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:39.405814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:39.406605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:39.407307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:39.408473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:39.409636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:39.410358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:39.441643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-04f12a58-84a7-4140-a709-d8a3712082c7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056316 Aug 05 05:21:39.442182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 410/823] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:40.458333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:40.461917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:40.469387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:40.469874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:40.470301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:40.470984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:40.471428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:40.471873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:40.502807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4bb185ff-6bb6-458f-a873-00e22d967674 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051096 Aug 05 05:21:40.503428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 414/824] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:41.520875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:41.524438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:41.535803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:41.536664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:41.537403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:41.538535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:41.539282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:41.540111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:41.570479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a7c32eb2-00e5-4948-ae8a-f2bdd9db4e0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056327 Aug 05 05:21:41.571043 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 411/825] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:42.587681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:42.590306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:42.597383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:42.597869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:42.598295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:42.598998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:42.599442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:42.599896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:42.638061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e8939f2d-d9a4-436e-99d5-401d6aa45a58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057228 Aug 05 05:21:42.638593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 415/826] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:43.651837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:43.654443 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:43.662743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:43.663309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:43.663996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:43.664803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:43.665388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:43.665872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:43.697254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ac05a34e-b0a5-4c2b-b7a9-582bc53694c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050501 Aug 05 05:21:43.697802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 412/827] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:44.709384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:44.711556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:44.718458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:44.718943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:44.719377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:44.720103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:44.720551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:44.720972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:44.749172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c792a592-ab66-4df8-9e76-d02a4b000a35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Aug 05 05:21:44.749692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 416/828] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:45.767145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:45.770663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:45.780291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:45.780775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:45.781204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:45.781895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:45.782366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:45.782782 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:45.811920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a5f218f5-e7dd-445a-b2af-4b6490abc24c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051440 Aug 05 05:21:45.812476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 413/829] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:46.828389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:46.831827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:46.842975 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:46.843836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:46.844533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:46.845659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:46.846413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:46.847105 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:46.879724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5d4599e5-38a2-4574-b2b6-5f3c648ad053 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058211 Aug 05 05:21:46.880310 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 417/830] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:47.896576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:47.900106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:47.911508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:47.912368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:47.913079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:47.914207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:47.914956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:47.915650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:47.945645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1e520462-6499-462e-81f6-f77f685813e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055814 Aug 05 05:21:47.946187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 414/831] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:48.962511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:48.966089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:48.972898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:48.973380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:48.973820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:48.974500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:48.974945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:48.975518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:49.005438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f00b9fda-3f9b-413a-95bb-75e745e38cad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049533 Aug 05 05:21:49.006000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 418/832] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:50.018994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:50.021272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:50.028375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:50.028878 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:50.029322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:50.030035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:50.030500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:50.030939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:50.061532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cf256f34-a91c-4350-bdd2-0833ddaca659 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Aug 05 05:21:50.062264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 415/833] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:51.074146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:51.076360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:51.082926 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:51.083370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:51.083829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:51.084541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:51.084978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:51.085390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:51.114871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-edec961e-4697-4ae1-b736-88ad0066ebf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Aug 05 05:21:51.115409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 419/834] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:52.131039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:52.134643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:52.143169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:52.143659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:52.144119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:52.144809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:52.145260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:52.145681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:52.175136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-43a4ed2b-83ec-42c5-a1c7-79a33177de0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050798 Aug 05 05:21:52.175606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 416/835] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:53.191820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:53.195412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:53.204938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:53.205423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:53.205851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:53.206540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:53.207050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:53.207404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:53.236476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8a68c89c-19e7-4c95-9064-5bd86d9857f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051394 Aug 05 05:21:53.237014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 420/836] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:54.253582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:54.256964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:54.267955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:54.268767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:54.269481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:54.270614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:54.271354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:54.272104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:54.304579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4973e55a-12ba-4256-a279-c0aa1bc17507 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057992 Aug 05 05:21:54.305150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 417/837] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:55.321333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:55.324777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:55.332563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:55.333038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:55.333466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:55.334147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:55.334589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:55.335001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:55.364819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2b733b82-5b54-4782-bbd9-e6abeb391750 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050268 Aug 05 05:21:55.365383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 421/838] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:56.380110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:56.382792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:56.391064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:56.391695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:56.392284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:56.393148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:56.393699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:56.394228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:56.426428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b9842754-8603-4dc0-becb-24fb9cf9d702 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051434 Aug 05 05:21:56.427282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 418/839] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:57.443186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:57.446716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:57.456060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:57.456539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:57.456969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:57.457645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:57.458108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:57.458503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:57.488812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b752a29c-6b45-4af0-a269-9cd6c49fa510 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052275 Aug 05 05:21:57.489374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 422/840] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:58.502608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:58.504900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:58.511988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:58.512473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:58.512900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:58.513589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:58.514038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:58.514459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:58.544436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-17331838-dcf2-49d3-89da-ef7382a61f29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 05 05:21:58.544975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 419/841] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:21:59.561544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:21:59.564140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:21:59.572602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:59.573376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:59.573866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:59.574798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:21:59.575325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:21:59.575787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:21:59.606091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c3c28c98-3a56-440b-98b6-5aa0d2ea4cd0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051756 Aug 05 05:21:59.606658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 423/842] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:21:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:00.623243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:00.626759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:00.630452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:00.639218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:00.640064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:00.640899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:00.641627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:00.642076 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:00.642495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:00.645090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:00.673608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ba84807d-1dc5-49e3-92a6-daec97a73854 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057179 Aug 05 05:22:00.674166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 420/843] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:01.690260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:01.693790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:01.704755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:01.705559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:01.706269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:01.707438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:01.708221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:01.708918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:01.712816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:01.743082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5b1850d8-4787-4157-81ee-b0ec0ebf1ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059721 Aug 05 05:22:01.743642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 424/844] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:02.759879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:02.763719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:02.771311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:02.771796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:02.772245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:02.772963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:02.773413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:02.773823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:02.803270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-07daa4cd-5af3-46ff-aa7a-04050eba9994 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050145 Aug 05 05:22:02.803860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 421/845] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:03.817216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:03.819439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:03.821859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:03.827524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:03.828173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:03.828447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:03.829138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:03.829582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:03.829997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:03.859803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d417f5f4-dcce-4fe0-8d1b-cf1215dda5b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047377 Aug 05 05:22:03.860366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 425/846] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:04.872191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:04.874273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:04.881182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:04.881720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:04.882254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:04.882953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:04.883397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:04.883822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:04.913984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-88ca7387-71de-4492-9b49-2208caf40911 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045840 Aug 05 05:22:04.914548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 422/847] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:05.926944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:05.929193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:05.936315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:05.936802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:05.937236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:05.937926 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:05.938381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:05.938806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:05.967902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bf2060a7-b926-407c-8742-c141c0a0aec7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Aug 05 05:22:05.968454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 426/848] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:06.980504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:06.982615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:06.989362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:06.989849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:06.990274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:06.990950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:06.991394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:06.991819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:07.021471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5563dfa9-6f83-4950-a3b4-8533c37e15ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Aug 05 05:22:07.022031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 423/849] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:08.034664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:08.036884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:08.043724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:08.044242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:08.044671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:08.045349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:08.045792 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:08.046207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:08.075662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e236f9e6-1bbb-4bab-9f03-3ba8588a115e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Aug 05 05:22:08.076248 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 427/850] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:09.093538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:09.096632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:09.103294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:09.103805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:09.104346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:09.105061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:09.105528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:09.105959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:09.137195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-be62ec4c-7b91-4c1c-a41d-5c51c40213b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050544 Aug 05 05:22:09.137740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 424/851] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:10.153872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:10.157432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:10.168714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:10.169568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:10.170284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:10.171396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:10.172352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:10.173050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:10.202985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f5894b0d-225e-4134-a4c0-9a26f9399329 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055924 Aug 05 05:22:10.203539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 428/852] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:11.218876 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:11.222402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:11.233271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:11.234160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:11.234885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:11.236083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:11.236829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:11.237524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:11.272394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a291b39d-eed4-4c7e-9eb6-eab469a12fd4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060135 Aug 05 05:22:11.272871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 425/853] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:12.285747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:12.287894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:12.294772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:12.295252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:12.295677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:12.296394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:12.296832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:12.297248 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:12.327540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5e0aec73-c957-4c73-b3ff-2fc9516c5726 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 05 05:22:12.328331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 429/854] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:13.340288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:13.342368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:13.349035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:13.349516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:13.349947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:13.350634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:13.351083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:13.351499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:13.380746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fc22817c-d9d5-4b07-b8d2-58e41b1f6d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 05 05:22:13.381293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 426/855] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:14.395470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:14.398047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:14.404924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:14.405414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:14.405851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:14.406540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:14.406991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:14.407413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:14.437655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1cb3d88d-9b73-4e06-986b-ff4bc84df2bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047605 Aug 05 05:22:14.438212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 430/856] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:15.454451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:15.458153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:15.469022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:15.469830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:15.470549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:15.471689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:15.472592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:15.473294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:15.503119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-40e0a786-63e6-4c2b-970d-21e3efe2f4dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055422 Aug 05 05:22:15.503653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 427/857] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:16.520030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:16.522417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:16.529544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:16.530043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:16.530475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:16.531164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:16.531608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:16.532058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:16.563477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-88847556-315a-4683-9e28-40fe3f56dec8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050213 Aug 05 05:22:16.564072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 431/858] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:17.580204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:17.584010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:17.594844 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:17.595646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:17.596406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:17.597548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:17.598293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:17.598990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:17.628591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-baa50179-27df-4441-ad63-9084b5827786 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054978 Aug 05 05:22:17.629191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 428/859] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:22:18.647608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:18.649740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:18.656595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:18.657078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:18.657510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:18.658201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:18.658644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:18.659413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:18.688563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1dc503a5-8294-4c02-ab31-dce5ffba96f0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048907 Aug 05 05:22:18.689115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 432/860] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:19.705453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:19.709031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:19.715959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:19.716443 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:19.716866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:19.717548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:19.718000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:19.718415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:19.747486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9e87eab2-6921-400f-ad8e-d0c5cc0920d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048702 Aug 05 05:22:19.748050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 429/861] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:20.759681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:20.761919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:20.768379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:20.768896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:20.769307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:20.770049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:20.770492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:20.770913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:20.800917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-60580d9a-2f3e-4d21-9c75-3465ab2333a8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Aug 05 05:22:20.801739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 433/862] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:21.817656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:21.821061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:21.832240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:21.833012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:21.833886 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:21.834613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:21.835056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:21.835477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:21.865660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f4ef3c39-11f6-4ffd-8b17-d1f5e06fa5bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054778 Aug 05 05:22:21.866217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 430/863] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:22.882757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:22.885526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:22.892784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:22.893315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:22.893792 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:22.894589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:22.895074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:22.895528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:22.926994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d3250368-d2ea-4729-8d59-f2f862c2c6a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050994 Aug 05 05:22:22.927546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 434/864] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:23.941780 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:23.944906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:23.955280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:23.955968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:23.956566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:23.957597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:23.958198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:23.958774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:23.988880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-97d20b2d-71d3-4b05-af3e-5ed802cfd433 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053699 Aug 05 05:22:23.989431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 431/865] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:25.005955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:25.008307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:25.015141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:25.015620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:25.016093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:25.016780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:25.017219 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:25.017630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:25.047859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-749a33ff-41bf-420c-8900-81605a12bb6c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048828 Aug 05 05:22:25.048400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 435/866] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:26.062090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:26.064851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:26.072495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:26.072982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:26.073415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:26.074100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:26.074545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:26.074968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:26.104407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9d830e65-ec46-481c-bad5-ffe69c7779f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047427 Aug 05 05:22:26.104967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 432/867] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:27.117261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:27.119453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:27.126389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:27.126871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:27.127301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:27.128026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:27.128470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:27.128893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:27.159976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4eb3b4d1-7172-4aba-8200-bcb2c249ef60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Aug 05 05:22:27.160524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 436/868] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:28.172401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:28.174651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:28.181613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:28.182102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:28.182539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:28.183245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:28.183696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:28.184131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:28.213932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-54eb513c-a5ff-4317-8431-3bfa3bafdfb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Aug 05 05:22:28.214493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 433/869] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:29.225859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:29.228053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:29.234922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:29.235369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:29.235808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:29.236492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:29.236931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:29.237344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:29.267251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-50880f95-731f-4032-9be4-14ac3bcd42b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Aug 05 05:22:29.267734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 437/870] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:30.279945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:30.282005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:30.289372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:30.289858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:30.290301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:30.290991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:30.291437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:30.291894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:30.321333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a7e7540d-4614-4eb4-802f-bf81cb5b50fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Aug 05 05:22:30.321892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 434/871] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:31.333696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:31.335935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:31.342996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:31.343490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:31.343971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:31.344663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:31.345114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:31.345537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:31.374812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d431c104-b980-47b1-8790-108983df5823 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045150 Aug 05 05:22:31.375367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 438/872] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:32.386851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:32.389081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:32.391406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:32.396884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:32.397368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:32.397796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:32.398478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:32.398933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:32.399344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:32.401918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:32.430037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e747e118-e82f-4556-ac08-90bfd494fedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047260 Aug 05 05:22:32.430586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 435/873] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:33.446617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:33.450128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:33.461072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:33.461859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:33.462567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:33.463679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:33.464454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:33.465142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:33.469058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:33.499175 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-70b6213c-0fb1-4a57-8277-3859c981b38c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059251 Aug 05 05:22:33.499704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 439/874] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:34.516150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:34.519684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:34.527398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:34.527921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:34.528352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:34.529000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:34.529444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:34.529855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:34.561711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c38a3923-544e-48f1-91bd-701975ae33de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052232 Aug 05 05:22:34.562294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 436/875] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:35.580156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:35.583638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:35.587309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:22:35.596584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:35.597376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:35.598087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:35.599214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:35.600034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:35.600455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:35.630562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-96de79f8-4efc-479e-8150-7142f1cf2047 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057069 Aug 05 05:22:35.631092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 440/876] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:36.647038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:36.649136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:36.655929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:36.656398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:36.656820 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:36.657496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:36.657935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:36.658344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:36.688135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ecac4b54-4aa8-4ff2-ab84-906f7aa0c0f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Aug 05 05:22:36.688682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 437/877] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:37.704686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:37.708255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:37.715638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:37.716141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:37.716571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:37.717246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:37.717694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:37.718109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:37.748740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ebb56793-0a1a-4ca5-9593-b855aa261988 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050663 Aug 05 05:22:37.749195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 441/878] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:38.767346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:38.770825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:38.781484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:38.782281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:38.782981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:38.784573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:38.785306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:38.786002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:38.816825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b0f6c3be-33f2-4cd7-8f9c-cf60a9043f1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056437 Aug 05 05:22:38.817367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 438/879] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:39.834454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:39.837401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:39.845134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:39.845659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:39.846136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:39.846912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:39.847406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:39.847913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:39.879501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aa93d2d7-0695-4d68-894c-17dd4550a3dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051968 Aug 05 05:22:39.880109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 442/880] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:40.897199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:40.900588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:40.911304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:40.912199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:40.912919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:40.914083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:40.914660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:40.915078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:40.944084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2b302d65-1f28-4672-85d3-24a346061a0e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053979 Aug 05 05:22:40.944630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 439/881] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:41.958326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:41.961090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:41.967963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:41.968443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:41.968869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:41.969557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:41.969996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:41.970407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:42.000941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4e5eb858-7f18-4961-b13f-96bb55603c5a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047697 Aug 05 05:22:42.001524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 443/882] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:43.014623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:43.016909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:43.023894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:43.024381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:43.024810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:43.025497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:43.025943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:43.026360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:43.056185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f9bf7685-ff5e-4ad6-94b6-2dbfda3406be tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Aug 05 05:22:43.056768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 440/883] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:44.072046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:44.075534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:44.086596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:44.087498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:44.087972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:44.088657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:44.089105 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:44.089524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:44.119850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6dfec5f2-5a27-4fde-9c17-1e817b9c1a1d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054609 Aug 05 05:22:44.120415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 444/884] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:45.136945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:45.140667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:45.150823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:45.151307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:45.151742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:45.152463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:45.152907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:45.153326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:45.183494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6ca03ad7-23cf-4465-b53a-a5e57971aa89 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053371 Aug 05 05:22:45.184077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 441/885] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:46.200484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:46.204012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:46.214842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:46.215639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:46.216415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:46.217545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:46.218340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:46.219079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:46.252263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a8040632-9763-4fe5-acac-74d75399b34a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058711 Aug 05 05:22:46.252824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 445/886] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:47.265031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:47.267182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:47.274099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:47.274586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:47.275064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:47.275791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:47.276245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:47.276656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:47.307225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a37a9524-dfc8-45ce-b0dc-700417e971c6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 Aug 05 05:22:47.308154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 442/887] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:48.322631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:48.324835 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:48.331609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:48.332217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:48.332650 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:48.333337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:48.333784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:48.334202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:48.363998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aec4778b-0b95-46ed-81e9-600c6bfb8f41 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047528 Aug 05 05:22:48.364592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 446/888] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:49.376472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:49.378701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:49.385584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:49.386072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:49.386497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:49.387190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:49.387639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:49.388113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:49.417869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f31c35c2-4f94-4cf1-97a9-e3de5f7d9295 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 05 05:22:49.418503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 443/889] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:50.430422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:50.432688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:50.439492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:50.440003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:50.440428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:50.441104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:50.441543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:50.441954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:50.471624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3b397950-324b-49d6-8657-3cb35409a16a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Aug 05 05:22:50.472200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 447/890] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:51.486006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:51.488255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:51.495096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:51.495580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:51.496038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:51.496723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:51.497167 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:51.497584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:51.527123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c9791afa-efd7-4cde-a749-268daca6f0ea tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Aug 05 05:22:51.527661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 444/891] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:52.542573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:52.545976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:52.555980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:52.556488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:52.556900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:52.557607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:52.558057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:52.558479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:52.588011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4caa3e4c-1d7e-477d-8144-37f64cc0f632 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051930 Aug 05 05:22:52.588563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 448/892] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:53.605679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:53.609169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:53.620007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:53.620755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:53.621513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:53.622652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:53.623406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:53.624154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:53.657858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-40523bf3-4bfb-4158-8e0d-b1f068adfd91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059084 Aug 05 05:22:53.658770 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 445/893] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:54.674464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:54.678004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:54.686256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:54.686733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:54.687161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:54.687929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:54.688373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:54.688787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:54.718371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eb78510f-2537-43f0-b512-54d12041c36c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050776 Aug 05 05:22:54.718921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 449/894] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:55.737378 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:55.740819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:55.751828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:55.752645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:55.753365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:55.754492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:55.755273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:55.755977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:55.786944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-370b654f-d656-4e01-a937-5aeef4ee0938 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056437 Aug 05 05:22:55.787735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 446/895] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:56.803962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:56.807366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:56.815289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:56.815892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:56.816398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:56.817197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:56.817801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:56.818253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:56.850262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-266aafd0-1ab9-44fc-a33a-6ca57ec3d5b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052892 Aug 05 05:22:56.850794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 450/896] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:57.866743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:57.869964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:57.877013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:57.877516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:57.877964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:57.878681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:57.879142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:57.879575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:57.910744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-348a4aa6-548b-42e1-bac3-06cae15d312a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050642 Aug 05 05:22:57.911267 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 447/897] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:58.925141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:58.928086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:58.937095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:58.937739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:58.938312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:58.939219 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:22:58.939894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:22:58.940405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:22:58.972164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f625080c-5d03-4ce7-8748-3c7dc57f3b3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052404 Aug 05 05:22:58.972718 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 451/898] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:22:59.988877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:22:59.992353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:22:59.999921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:00.000624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:00.000815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:00.001499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:00.001941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:00.002356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:00.032766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-45ab5bcd-07be-4bab-b277-e38219cebf50 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050596 Aug 05 05:23:00.033675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 448/899] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:22:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:01.049119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:01.051422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:01.059350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:01.059927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:01.060414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:01.061170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:01.061668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:01.062111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:01.092442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6739e1cb-22d9-4bd1-b448-02dcfa344f38 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048032 Aug 05 05:23:01.093000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 452/900] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:02.109318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:02.112700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:02.122534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:02.123011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:02.123435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:02.124157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:02.124599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:02.125008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:02.157838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-96a698c6-9281-41a8-b13a-62a1869ef386 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054996 Aug 05 05:23:02.158972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 449/901] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:03.178659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:03.182201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:03.198404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:03.198899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:03.199364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:03.202407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:03.202879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:03.203324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:03.238336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ca62a2c5-fcd1-4fe1-9f3c-df8828c3eefc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067734 Aug 05 05:23:03.238894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 453/902] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:04.255316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:04.258846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:04.261577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:04.266968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:04.267447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:04.267921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:04.268611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:04.269047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:04.269467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:04.272058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:04.300494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3d426db0-859f-4c25-9ee5-33ff9fed94da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051884 Aug 05 05:23:04.301062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 450/903] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:05.313772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:05.315982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:05.323182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:05.323657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:05.324189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:05.324870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:05.325311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:05.325726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:05.328072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:05.356410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-84fe8947-f40b-4307-843e-e571746a1518 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Aug 05 05:23:05.356956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 454/904] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:06.373429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:06.377439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:06.386723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:06.387205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:06.387629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:06.388359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:06.388783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:06.389189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:06.418977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8f10e41b-c519-468f-81b0-4b302b3fdc2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052416 Aug 05 05:23:06.419516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 451/905] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:07.438258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:07.441769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:07.445383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:07.454171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:07.454945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:07.455644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:07.456826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:07.457566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:07.458257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:07.490507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-673a62f7-efb8-4d16-a585-fd019357a2bb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059071 Aug 05 05:23:07.491017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 455/906] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:08.504088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:08.506677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:08.514179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:08.514668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:08.515101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:08.515799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:08.516281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:08.516734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:08.548811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5d16214b-1b0c-4e99-b854-1d781eb8d8ad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049469 Aug 05 05:23:08.549395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 452/907] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:09.566173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:09.569922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:09.581270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:09.582106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:09.583101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:09.584216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:09.585136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:09.585824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:09.774756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-be77a27d-1a37-4e20-919a-1944b1002aa8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215344 Aug 05 05:23:09.775679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 456/908] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:10.791236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:10.794225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:10.800742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:10.801242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:10.801674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:10.802366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:10.802814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:10.803237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:10.832642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6386893e-60b3-4a53-9ffa-f7e8aa5fe2c1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048088 Aug 05 05:23:10.833196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 453/909] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:11.849176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:11.852630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:11.863822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:11.864667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:11.865394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:11.866522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:11.867280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:11.868140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:11.899810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f876f31b-03fd-451e-930d-6525296b6245 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057350 Aug 05 05:23:11.900403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 457/910] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:12.917216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:12.919941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:12.926858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:12.927348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:12.927800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:12.928544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:12.929003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:12.929432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:12.959116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-12b9c338-3526-4950-88f5-43e16ca6a280 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Aug 05 05:23:12.959587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 454/911] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:13.184576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:23:13.184747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:23:13.976299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:13.979804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:13.990694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:13.991388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:13.992182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:13.993362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:13.994107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:13.994803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:14.025576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-67e49a09-cff6-4b1f-b56a-fc87570b9912 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055978 Aug 05 05:23:14.026129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 458/912] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:15.039676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:15.041821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:15.049821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:15.050299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:15.050727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:15.051386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:15.051898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:15.052310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:15.083289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a47a9df2-50a5-4ec8-afa1-1cadbe7f708d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047847 Aug 05 05:23:15.084098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 455/913] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:16.100524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:16.103991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:16.111903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:16.112396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:16.112836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:16.113539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:16.113992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:16.114410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:16.145516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9c60abe0-a225-4991-9cea-5a52c76ed512 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051816 Aug 05 05:23:16.146072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 459/914] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:17.164798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:17.168054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:17.178784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:17.179506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:17.180203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:17.181266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:17.181901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:17.182470 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:17.212030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6c51c996-d449-4b98-b67c-82af3cb08e56 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054102 Aug 05 05:23:17.212543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 456/915] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:18.229015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:18.232190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:18.239810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:18.240376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:18.240853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:18.241604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:18.242093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:18.242552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:18.275545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ca6b902e-d681-40a6-b5c7-6d8d6d307b83 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053184 Aug 05 05:23:18.276136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 460/916] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:19.291470 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:19.294728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:19.304560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:19.305291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:19.305937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:19.306993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:19.307485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:19.308328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:19.337882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a8b7dbb4-433d-4e32-8fd6-bbf4e68ef688 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052780 Aug 05 05:23:19.338425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 457/917] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:20.354740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:20.357407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:20.364209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:20.364690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:20.365118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:20.365797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:20.366241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:20.366652 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:20.396142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-37f3b9a4-bae1-44e3-b0ee-d01b1cc38408 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Aug 05 05:23:20.396693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 461/918] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:21.414239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:21.417769 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:21.424662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:21.425185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:21.425618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:21.426314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:21.426764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:21.427236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:21.457609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6f932b4-54d0-416f-b4a1-d6dee3ea7470 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051379 Aug 05 05:23:21.458218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 458/919] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:22.476666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:22.480142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:22.490436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:22.491230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:22.491975 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:22.493134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:22.493879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:22.494570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:22.527675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3f2b4c32-5eb6-4da0-96e2-104072593e39 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058005 Aug 05 05:23:22.528287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 462/920] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:23.544373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:23.546901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:23.553885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:23.554238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:23.554665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:23.555381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:23.555797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:23.556246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:23.588486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2948a9f7-764e-4a80-9df4-e5f400fdaeaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050875 Aug 05 05:23:23.589042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 459/921] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:24.819315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:24.821472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:24.827508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:24.828019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:24.828451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:24.829130 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:24.829578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:24.829991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:24.858169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e4318107-fcaa-4579-805e-fa750559a832 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261117 Aug 05 05:23:24.858643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 463/922] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:25.873854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:25.876438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:25.886148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:25.886819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:25.887275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:25.888039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:25.888530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:25.889096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:25.919845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ddb58f6c-e92b-4764-bb18-29379cf1a02d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052585 Aug 05 05:23:25.920456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 460/923] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:26.936610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:26.939254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:26.947632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:26.948287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:26.948836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:26.949696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:26.950268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:26.950797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:26.983657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-97cc0b93-c076-47bb-9387-54745ade7865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053695 Aug 05 05:23:26.984251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 464/924] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:28.000422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:28.004316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:28.014403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:28.014845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:28.015333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:28.016016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:28.016442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:28.016855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:28.046734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f5b85a35-e762-436e-911c-6bd42e7eed09 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053262 Aug 05 05:23:28.047278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 461/925] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:29.059413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:29.061686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:29.068632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:29.069113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:29.069546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:29.070229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:29.070681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:29.071097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:29.100187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8e977972-9f46-4eac-bd7b-26439eced22f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 05 05:23:29.100734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 465/926] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:30.116149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:30.119602 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:30.130666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:30.131472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:30.132258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:30.133420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:30.134174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:30.134864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:30.165781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2864036b-60c9-412e-b3da-cb4782089c17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056331 Aug 05 05:23:30.166323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 462/927] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:31.184026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:31.186902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:31.193984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:31.194466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:31.194899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:31.195583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:31.196070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:31.196495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:31.228591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-27440877-0420-44a9-b8cf-d0ad425568a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051322 Aug 05 05:23:31.229135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 466/928] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:32.245456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:32.248783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:32.255576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:32.256089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:32.256517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:32.257192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:32.257635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:32.258046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:32.288009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b816ddc4-51bc-4d5e-8183-b23359eead43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049348 Aug 05 05:23:32.288558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 463/929] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:33.306754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:33.310232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:33.320220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:33.320865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:33.321440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:33.322352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:33.322957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:33.323513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:33.353532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d525682c-b0d5-40d4-8c1e-d91f45f9e3eb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053617 Aug 05 05:23:33.354088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 467/930] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:34.370219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:34.373565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:34.376002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=28 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:34.381421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:34.381943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:34.382383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:34.383100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:34.383573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:34.384021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:34.386859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=84 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:34.415451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9917d16e-59e2-4a91-9074-fd8c3a83b720 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051960 Aug 05 05:23:34.416100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 464/931] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:35.428461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:35.430661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:35.437620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:35.438087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:35.438534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:35.439223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:35.439671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:35.440130 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:35.442480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=84 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:35.470282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-478bb4d0-294c-416c-94ad-671e8945a0e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045870 Aug 05 05:23:35.470839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 468/932] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:36.488389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:36.491995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:36.502854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:36.503656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:36.504434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:36.505564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:36.506319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:36.507014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:36.540432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3e20eb52-fa0d-4d5f-83ae-bba6c9f93014 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058950 Aug 05 05:23:36.540999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 465/933] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:37.555070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:37.557906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:37.560925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=28 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:23:37.567138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:37.567603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:37.568058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:37.568747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:37.569186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:37.569602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:37.599053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-14742304-d681-44ae-83dd-2c23fb7c939c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049347 Aug 05 05:23:37.599586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 469/934] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:38.611045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:38.613240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:38.619741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:38.620253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:38.620691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:38.621368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:38.621809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:38.622246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:38.651692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-88015447-d9f3-4714-8e9b-2d82ea469261 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Aug 05 05:23:38.652185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 466/935] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:39.664803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:39.667127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:39.673961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:39.674440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:39.674895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:39.675577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:39.676054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:39.676468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:39.705592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1d2de3e7-a907-4344-8bc7-e5f2d1bbe77d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Aug 05 05:23:39.706129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 470/936] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:40.722396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:40.725881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:40.737502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:40.738304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:40.739029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:40.740213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:40.740952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:40.741651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:40.773060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a5afe8fa-67d9-479e-a937-81c832c700a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056884 Aug 05 05:23:40.773599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 467/937] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:41.790185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:41.793673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:41.800935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:41.801415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:41.801843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:41.802522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:41.802969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:41.803389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:41.832748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5b54ef62-b117-4b6f-b548-e6479364abe9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049919 Aug 05 05:23:41.833305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 471/938] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:41.912348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:23:41.913171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:23:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:23:42.849352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:42.852823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:42.863617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:42.864459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:42.865164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:42.866355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:42.867079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:42.867825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:42.908868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c5230e15-ed04-4e5e-b293-cad250409334 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066155 Aug 05 05:23:42.909409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 468/939] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:43.921556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:43.923734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:43.930627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:43.931138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:43.931564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:43.932278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:43.932712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:43.933124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:43.962312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a94d2afd-85d0-4cf0-a26a-0148a7919059 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Aug 05 05:23:43.962855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 472/940] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:44.979132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:44.982617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:44.989488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:44.989967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:44.990418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:44.991096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:44.991542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:44.991986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:45.022417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f9ae8add-1f72-4d4d-bbe3-fd603b2c21fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050230 Aug 05 05:23:45.022977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 469/941] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:46.036091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:46.038245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:46.045126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:46.045607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:46.046027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:46.046708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:46.047153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:46.047568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:46.076861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-88a3f61b-532a-4fd8-8698-c63e5159e730 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Aug 05 05:23:46.077396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 473/942] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:47.093777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:47.097334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:47.108122 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:47.108605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:47.109035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:47.109723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:47.110177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:47.110595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:47.139939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3c04eb5d-4688-4d90-a9b9-e2b8d9e95c48 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052799 Aug 05 05:23:47.140484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 470/943] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:48.156419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:48.159335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:48.167705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:48.168364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:48.168901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:48.169719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:48.170296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:48.170812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:48.203595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bb8bd467-01c3-4230-aa9e-40ab8f2c9862 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053596 Aug 05 05:23:48.204184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 474/944] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:49.220327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:49.223686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:49.233874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:49.234364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:49.234791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:49.235487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:49.235971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:49.236388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:49.266982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-aa124ecb-dacf-4b7b-9be1-e4b04f375675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053519 Aug 05 05:23:49.267561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 471/945] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:50.283645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:50.286994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:50.296867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:50.297344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:50.297772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:50.298449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:50.298891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:50.299313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:50.328689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fdc8976f-8b5b-4e03-a816-64c6def01fb3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052516 Aug 05 05:23:50.329232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 475/946] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:51.345129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:51.347658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:51.356113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:51.356718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:51.357252 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:51.358098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:51.358676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:51.359231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:51.391799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-896be277-579e-4922-8ca3-0e556f463e17 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052669 Aug 05 05:23:51.392654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 472/947] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:52.408416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:52.412085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:52.421653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:52.422135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:52.422556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:52.423236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:52.423678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:52.424124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:52.452667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f5637cce-babf-4ad0-b756-3852f2d45e24 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051599 Aug 05 05:23:52.453209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 476/948] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:53.470380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:53.473957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:53.485364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:53.486162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:53.486874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:53.488050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:53.488791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:53.489479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:53.522021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bf08c1ed-5d92-4b3a-87a8-45c5cb2e257f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058953 Aug 05 05:23:53.522555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 473/949] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:54.539144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:54.542911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:54.550768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:54.551286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:54.551711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:54.552419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:54.552859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:54.553276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:54.582500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-223cd802-cc0b-4e80-9a7b-81116babfa57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050448 Aug 05 05:23:54.583040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 477/950] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:55.594838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:55.597036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:55.603998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:55.604476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:55.604904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:55.605578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:55.606015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:55.606434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:55.635845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-08355572-9c62-40ae-95e8-1f822dec6f6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Aug 05 05:23:55.636698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 474/951] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:56.652334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:56.655479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:56.663024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:56.663531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:56.664038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:56.664936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:56.665259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:56.665702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:56.696946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6e466503-bbb8-4d38-b26c-6b0eaeb35dac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051350 Aug 05 05:23:56.697471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 478/952] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:57.714001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:57.717235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:57.724660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:57.725448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:57.726146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:57.727029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:57.727626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:57.728355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:57.760149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b6305a27-b46e-4edd-85cb-a3d43174d54e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054285 Aug 05 05:23:57.760694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 475/953] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:58.772832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:58.774983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:58.781941 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:58.782742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:58.783199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:58.783911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:58.784353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:58.784768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:58.813632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0f45b3d4-1a1d-4d59-88d3-9fbda123f37b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Aug 05 05:23:58.814195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 479/954] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:23:59.826173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:23:59.828413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:23:59.835278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:59.835793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:59.836247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:59.836938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:23:59.837381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:23:59.837797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:23:59.867636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0c845873-f69b-4517-bb3a-ba6934420ae0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Aug 05 05:23:59.868305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 476/955] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:23:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:00.884075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:00.887554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:00.899107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:00.899961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:00.900687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:00.901812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:00.902610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:00.903309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:00.933894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-00088b48-d489-4d3e-9ae8-f19954cf14c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056541 Aug 05 05:24:00.934439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 480/956] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:01.948604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:01.951453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:01.958786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:01.959258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:01.959687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:01.960408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:01.960856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:01.961279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:01.990417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-58ef4046-56b3-4f19-8d7b-e220e66ca157 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Aug 05 05:24:01.990970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 477/957] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:03.007156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:03.010752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:03.019454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:03.019974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:03.020428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:03.021096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:03.021545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:03.021971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:03.051205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-76ea01c2-44ef-4260-8069-297d15b63bc6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050773 Aug 05 05:24:03.051753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 481/958] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:04.064125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:04.066297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:04.073221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:04.073718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:04.074140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:04.074830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:04.075284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:04.075702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:04.105376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-295cc3a3-13cc-4c8d-adb5-e1677c1c22cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 05 05:24:04.105919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 478/959] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:05.121752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:05.125299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:05.136496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:05.137315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:05.138030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:05.139176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:05.139963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:05.140665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:05.171030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-45276a49-9449-4b3b-a5b2-a66979ca4b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056030 Aug 05 05:24:05.171633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 482/960] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:06.187743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:06.190279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:06.193188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:06.199799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:06.200397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:06.200900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:06.201704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:06.202223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:06.202723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:06.205763 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:06.235680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d11c2321-754b-4a4a-b584-ed34bedc4e42 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054573 Aug 05 05:24:06.236240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 479/961] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:07.253539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:07.257085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:07.267198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:07.267674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:07.268138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:07.268808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:07.269244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:07.269672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:07.272052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:07.300553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ebd8f0c6-3257-4aad-b7b4-296e0a61cd18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054626 Aug 05 05:24:07.301119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 483/962] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:08.317911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:08.321273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:08.332125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:08.332927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:08.333641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:08.337579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:08.338349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:08.340250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:08.375420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bcc655af-bd07-4752-87b5-71cb2fb1d5f4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064693 Aug 05 05:24:08.376015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 480/963] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:09.392991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:09.395182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:09.397709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:09.403755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:09.404290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:09.404747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:09.405484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:09.405955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:09.406404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:09.437900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-77d690a1-7043-448e-b2a3-f6402a3432c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050565 Aug 05 05:24:09.438445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 484/964] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:10.451915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:10.454451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:10.460851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:10.461332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:10.461759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:10.462449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:10.462888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:10.463314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:10.493280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-167ebe3b-80dc-416c-a00a-e4100d411eaa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046640 Aug 05 05:24:10.493829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 481/965] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:11.510110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:11.513606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:11.524625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:11.525459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:11.526222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:11.527386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:11.528161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:11.528853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:11.559504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-357a13f8-7106-4c45-ae9c-68ba8832c694 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056189 Aug 05 05:24:11.560078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 485/966] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:12.576490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:12.579562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:12.587384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:12.587986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:12.588487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:12.589275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:12.589791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:12.590277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:12.775409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3a5a5cb4-a713-4572-9601-eb2e481470ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205521 Aug 05 05:24:12.775893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 482/967] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:13.787883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:13.790794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:13.797638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:13.798120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:13.798587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:13.799379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:13.799912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:13.800255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:13.832085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-68a4ee8f-2506-42a6-9b81-63b0404723b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048229 Aug 05 05:24:13.832641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 486/968] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:14.848345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:14.851845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:14.862746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:14.863141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:14.863607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:14.864264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:14.864705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:14.865116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:14.894648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6ddc4081-7db9-4e9a-808b-4b095e0c59b5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052699 Aug 05 05:24:14.895223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 483/969] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:15.908007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:15.910251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:15.916789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:15.917266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:15.917689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:15.918362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:15.918802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:15.919211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:15.947972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1f26d74b-1634-4c4a-9a89-6afd579815af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Aug 05 05:24:15.948533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 487/970] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:16.962403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:16.964651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:16.971600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:16.972127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:16.972562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:16.973255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:16.973713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:16.974135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:17.005260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c0f83818-49db-471c-a4af-99773d399ddb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046859 Aug 05 05:24:17.005794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 484/971] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:18.017938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:18.020139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:18.026915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:18.027402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:18.027822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:18.028532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:18.028970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:18.029381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:18.059184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3eef4035-d6c2-4a48-a1f6-cf6e90dac3b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Aug 05 05:24:18.059722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 488/972] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:19.071996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:19.074187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:19.081337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:19.081831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:19.082263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:19.082969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:19.083392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:19.083874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:19.115270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eaad6c78-6651-4bff-974d-e6ecae68ff32 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Aug 05 05:24:19.115814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 485/973] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:20.128065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:20.130292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:20.136831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:20.137301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:20.137726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:20.138403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:20.138878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:20.139259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:20.169497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4e98e838-6d61-4380-b5c9-1467cafa78de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Aug 05 05:24:20.170059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 489/974] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:21.186288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:21.189694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:21.197399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:21.197888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:21.198320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:21.199009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:21.199463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:21.199924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:21.229759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b613d68e-6c23-46ad-a591-ea0c69218f0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050215 Aug 05 05:24:21.230283 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 486/975] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:22.246917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:22.250453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:22.260878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:22.261537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:22.262244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:22.263373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:22.264169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:22.264864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:22.296932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-15ff83d7-bfa3-4b5f-8979-6693c1d3f86b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057058 Aug 05 05:24:22.297485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 490/976] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:23.313964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:23.317311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:23.324130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:23.324619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:23.325046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:23.325731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:23.326176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:23.326597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:23.356245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0cc16a2a-4292-44ec-aa44-b0b45e1cb2c4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Aug 05 05:24:23.356835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 487/977] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:24.369958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:24.372182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:24.378920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:24.379405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:24.379897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:24.380579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:24.381035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:24.381503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:24.411821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-630cc7cc-f18a-4c28-bf0e-b75351f94293 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 05 05:24:24.412377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 491/978] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:25.428879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:25.432503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:25.442807 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:25.443291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:25.443727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:25.444456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:25.444908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:25.445333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:25.476452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-82f983d5-5e4a-4231-9b35-4f85ce6bcfba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054460 Aug 05 05:24:25.477019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 488/979] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:26.495063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:26.498471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:26.507181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:26.507662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:26.508118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:26.508802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:26.509240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:26.509656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:26.539222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-43930f7d-58ce-41bf-a335-94ccbd0c6f3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050526 Aug 05 05:24:26.539758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 492/980] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:27.556306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:27.559618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:27.570881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:27.571891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:27.572841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:27.574064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:27.574805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:27.575680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:27.608118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7e383164-c2c6-410f-89ea-37ce9b79f8f6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058677 Aug 05 05:24:27.608660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 489/981] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:28.620907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:28.623004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:28.629776 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:28.630250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:28.630678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:28.631354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:28.631826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:28.632298 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:28.661903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-06b67d54-ea2f-4514-a108-9e48315b9e3a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045122 Aug 05 05:24:28.662449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 493/982] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:29.678858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:29.681329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:29.688257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:29.688776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:29.689180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:29.689870 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:29.690318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:29.690737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:29.720272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e3ab7386-50b1-4abb-b73c-989b27a460ec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048246 Aug 05 05:24:29.720818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 490/983] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:30.737008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:30.740662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:30.751558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:30.752410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:30.753139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:30.754265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:30.755001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:30.755692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:30.786746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6a7cd5dd-9615-45bd-a8fe-a83622f4d76f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056501 Aug 05 05:24:30.787296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 494/984] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:31.803556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:31.806903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:31.814573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:31.815118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:31.815598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:31.816395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:31.816894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:31.817356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:31.848141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1bf261d6-5e4b-45e3-a150-c4a9e0def78e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051325 Aug 05 05:24:31.848673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 491/985] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:32.864805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:32.868199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:32.879165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:32.880013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:32.880728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:32.881851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:32.882584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:32.883276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:32.920539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-15cb09fa-6862-4efd-bd1b-19ef2d6249cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062722 Aug 05 05:24:32.921121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 495/986] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:33.936542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:33.939080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:33.946735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:33.947233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:33.947672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:33.948393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:33.948841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:33.949261 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:33.978437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7c7f6514-f13c-4078-8bfa-5b2d3007ffaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046485 Aug 05 05:24:33.978962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 492/987] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:34.994829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:34.997624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:35.004153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:35.004641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:35.005071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:35.005768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:35.006221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:35.006641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:35.037768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4abda33a-0d3e-4c57-8af5-75072fb8a22d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049665 Aug 05 05:24:35.038327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 496/988] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:36.052393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:36.054653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:36.061452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:36.061937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:36.062370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:36.063061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:36.063508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:36.063968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:36.092799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-796f296d-315f-4019-b0c0-b65e631de9bc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Aug 05 05:24:36.093330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 493/989] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:37.106354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:37.108584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:37.115543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:37.116067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:37.116502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:37.117182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:37.117624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:37.118047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:37.148837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f91f1ff7-55ab-4541-884b-f4dba0141bbf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Aug 05 05:24:37.149408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 497/990] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:38.166010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:38.168652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:38.171168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:38.176925 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:38.177435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:38.177894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:38.178620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:38.179072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:38.179520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:38.182216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:38.210852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-987043da-38e0-4afb-8ad3-8f976fe077b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051559 Aug 05 05:24:38.211641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 494/991] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:39.227404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:39.230989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:39.241685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:39.242439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:39.243148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:39.244317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:39.245046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:39.245460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:39.247808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:39.276553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-78f62209-99c1-4ca2-b49c-ab064700fb45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055587 Aug 05 05:24:39.277026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 498/992] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:40.293071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:40.295218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:40.301915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:40.302425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:40.302880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:40.303588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:40.304090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:40.304527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:40.335257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8699450e-3954-4d14-943f-90583c179036 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048904 Aug 05 05:24:40.336095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 495/993] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:41.351265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:41.354647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:41.356969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:24:41.362333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:41.362808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:41.363234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:41.363948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:41.364389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:41.364794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:41.393806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-51ca4079-db26-4338-8cf7-0e444ecf48a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049453 Aug 05 05:24:41.394354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 499/994] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:42.411040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:42.414658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:42.425623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:42.426426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:42.427227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:42.428420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:42.429164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:42.429854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:42.460538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c9924962-410d-4289-b3e9-3a8e53899ca6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056523 Aug 05 05:24:42.461012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 496/995] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:43.477069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:43.480301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:43.487196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:43.487623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:43.488083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:43.488779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:43.489229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:43.489654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:43.519338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-de0e98ca-e478-4105-a729-fed65af71e54 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049050 Aug 05 05:24:43.519889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 500/996] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:44.533563 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:44.535618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:44.542415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:44.542895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:44.543322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:44.544044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:44.544484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:44.544898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:44.574186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-28e8ebb7-3410-409c-88ef-0d84296cb435 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Aug 05 05:24:44.574732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 497/997] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:45.592779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:45.596218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:45.607081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:45.607733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:45.608206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:45.608919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:45.609373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:45.609794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:45.639780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4ffd8977-d114-475f-ba4f-21b30b05d00c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053963 Aug 05 05:24:45.640354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 501/998] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:46.655994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:46.659717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:46.670487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:46.671277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:46.672047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:46.673172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:46.673903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:46.674586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:46.708358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3865bbc1-be3d-4e70-8238-af8cdf373539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059159 Aug 05 05:24:46.708903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 498/999] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:47.725040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:47.728627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:47.737771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:47.738247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:47.738678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:47.739364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:47.739843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:47.740266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:47.769433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fbf22059-9bb7-45f3-8a90-d56efcedf419 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051146 Aug 05 05:24:47.769975 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 502/1000] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:48.786768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:48.790132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:48.801117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:48.801938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:48.802649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:48.803833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:48.804574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:48.805271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:48.836884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ea6c250c-9e0a-474c-8e85-35ce20091533 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057424 Aug 05 05:24:48.837430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 499/1001] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:49.853652 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:49.857037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:49.867817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:49.868625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:49.869346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:49.870460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:49.871197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:49.871903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:49.903591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-59423a08-72ea-4030-8bea-081d12a02234 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056459 Aug 05 05:24:49.904614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 503/1002] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:50.920384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:50.922748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:50.929486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:50.929962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:50.930382 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:50.931067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:50.931507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:50.931970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:50.961597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-816555e0-7b52-4c88-bb8d-6436e87b6a1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047974 Aug 05 05:24:50.962136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 500/1003] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:51.979342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:51.982902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:51.993302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:51.994097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:51.994812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:51.995991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:51.996698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:51.997432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:52.030178 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d5edebe3-c685-4e95-a626-01b02b691aad tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058110 Aug 05 05:24:52.030741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 504/1004] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:53.046478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:53.048665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:53.055393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:53.055901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:53.056326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:53.057007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:53.057447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:53.057864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:53.086840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a484fd75-1f3f-4a64-8625-e6b51eb2458d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Aug 05 05:24:53.087373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 501/1005] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:54.103546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:54.107114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:54.118127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:54.118925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:54.119657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:54.120825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:54.121566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:54.122261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:54.152617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-100d64ea-2e5d-40df-9d4b-87e1af128a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055860 Aug 05 05:24:54.153163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 505/1006] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:55.169873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:55.172790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:55.179538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:55.180081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:55.180519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:55.181202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:55.181649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:55.182067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:55.211433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-57ca46f7-b9e3-4bd3-bdbd-f62b5e5ac3ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048340 Aug 05 05:24:55.212005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 502/1007] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:56.228244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:56.231715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:56.242508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:56.243723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:56.244493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:56.245612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:56.246355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:56.247041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:56.278030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-94373909-ab7f-464e-b993-f0e3306e10f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056406 Aug 05 05:24:56.278490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 506/1008] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:57.294911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:57.298233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:57.309249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:57.310036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:57.310745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:57.311919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:57.312789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:57.313217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:57.342374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b39efcdd-6466-48d1-aca5-e804785af9da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054401 Aug 05 05:24:57.343135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 503/1009] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:58.359187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:58.361586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:58.368742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:58.369230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:58.369669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:58.370346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:58.370812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:58.371232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:58.400741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f268d082-a7d0-447b-a90c-53659ec7b201 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048325 Aug 05 05:24:58.401285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 507/1010] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:24:59.413891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:24:59.416156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:24:59.425107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:59.425789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:59.426390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:59.427380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:24:59.428071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:24:59.428621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:24:59.460099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7d8491a5-6547-4cfa-91c2-bcac87e4e568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050485 Aug 05 05:24:59.460636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 504/1011] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:24:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:00.472763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:00.475004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:00.481822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:00.482303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:00.482732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:00.483415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:00.483894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:00.484321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:00.518052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-64112824-abd3-4653-9238-eec07590d65b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049213 Aug 05 05:25:00.518618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 508/1012] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:01.346848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:25:01.347700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:25:01.496851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:25:01.497336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:25:01.530798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:01.533418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:01.540356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:01.540841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:01.541269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:01.541962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:01.542406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:01.542824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:01.573212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-62d77c55-65e7-484a-a812-293cdc99da0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Aug 05 05:25:01.573747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 505/1013] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:02.591919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:02.595385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:02.607327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:02.608187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:02.608904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:02.610020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:02.610655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:02.611072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:02.640140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-14d803b0-be00-4732-9629-e55c0791404f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054893 Aug 05 05:25:02.640667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 509/1014] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:03.657385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:03.661050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:03.671909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:03.672835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:03.673266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:03.673958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:03.674403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:03.674828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:03.704796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5fbf05fe-3f4c-4a0e-aa14-212d4ef2776e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054643 Aug 05 05:25:03.705330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 506/1015] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:04.720497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:04.722612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:04.729682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:04.730180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:04.730613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:04.731300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:04.731746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:04.732208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:04.763775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a215129e-c48f-4659-81a9-490070734884 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Aug 05 05:25:04.764339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 510/1016] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:05.779675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:05.783614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:05.794547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:05.795350 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:05.796154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:05.797338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:05.798022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:05.798449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:05.828132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9396a267-4634-4d6d-8f59-cb625e997b37 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055242 Aug 05 05:25:05.828682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 507/1017] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:06.845265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:06.847907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:06.854940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:06.855428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:06.855894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:06.856582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:06.857032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:06.857453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:06.888051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e73b868b-92b1-4628-9db8-ef6ef6c9b56e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049584 Aug 05 05:25:06.888595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 511/1018] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:07.905727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:07.909682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:07.920906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:07.921692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:07.922434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:07.923522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:07.924298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:07.924963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:07.953957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b7acd012-728e-403b-aa37-d2fd8c18bd6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055880 Aug 05 05:25:07.954422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 508/1019] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:08.970780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:08.973695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:08.980736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:08.981166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:08.981596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:08.982299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:08.982728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:08.983146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:09.013111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-82943e84-2981-4e09-9969-3b967dd464d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049168 Aug 05 05:25:09.013888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 512/1020] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:10.029012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:10.032335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:10.035151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:10.042349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:10.042951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:10.043536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:10.044325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:10.044916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:10.045455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:10.049360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:10.077096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9fbdb3af-a82c-4414-9531-39777cf9a975 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054853 Aug 05 05:25:10.077617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 509/1021] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:11.090877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:11.093705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:11.100393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:11.100869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:11.101294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:11.101953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:11.102390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:11.102809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:11.106347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:11.131883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e8c40b4f-5521-4f08-9277-4b3f9f70ed0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Aug 05 05:25:11.132420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 513/1022] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:12.148718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:12.152090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:12.162940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:12.163419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:12.163880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:12.164559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:12.164999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:12.165414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:12.194308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fdf61dce-ee2f-4482-b3ef-fc250d119e6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052529 Aug 05 05:25:12.194842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 510/1023] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:13.210700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:13.213593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:13.216586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:13.223629 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:13.224329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:13.224897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:13.225805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:13.226396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:13.226967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:13.260884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6a128ee8-eff0-4905-8b82-538bd66c8990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056549 Aug 05 05:25:13.261437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 514/1024] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:14.273876 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:14.276009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:14.283224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:14.283722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:14.284173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:14.284894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:14.285333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:14.285847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:14.322180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-31f34319-9233-4318-95a1-b6d4e449a9a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046693 Aug 05 05:25:14.322180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 511/1025] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:15.329763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:15.331884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:15.338879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:15.339359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:15.339791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:15.340497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:15.340939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:15.341354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:15.371420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-27fbe058-3846-4fa0-a40e-40842723018b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Aug 05 05:25:15.372052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 515/1026] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:16.388940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:16.392424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:16.403220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:16.404082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:16.404788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:16.406304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:16.407039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:16.407842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:16.438584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-61f76dc0-0423-4ef2-b392-b87a85d544df tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056519 Aug 05 05:25:16.439115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 512/1027] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:17.451987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:17.454409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:17.462023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:17.462501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:17.462943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:17.463640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:17.464124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:17.464542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:17.493979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-47f8df96-503a-4b66-a285-c8deecc43f7f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046603 Aug 05 05:25:17.494535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 516/1028] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:18.512795 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:18.516338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:18.524889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:18.525371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:18.525797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:18.526490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:18.526940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:18.527360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:18.557193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-21277a06-2eb9-476f-bf41-3d83c218b233 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051138 Aug 05 05:25:18.557739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 513/1029] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:19.090756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:25:19.091527 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:25:19.571850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:19.574097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:19.580881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:19.581355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:19.581782 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:19.582462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:19.582917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:19.583350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:19.612345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a534ed51-1408-4531-baa3-4c4e017c4b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Aug 05 05:25:19.612895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 517/1030] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:20.626194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:20.628386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:20.635460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:20.635985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:20.636416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:20.637110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:20.637558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:20.637980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:20.667974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-304e1643-174d-45d0-8d39-bdeccd78c7fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Aug 05 05:25:20.668528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 514/1031] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:21.684993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:21.688496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:21.696634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:21.697104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:21.697535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:21.698222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:21.698662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:21.699075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:21.729452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5b77063d-a112-4254-b8d6-8a88176f02e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051430 Aug 05 05:25:21.729992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 518/1032] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:22.744798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:22.749548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:22.755902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:22.756387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:22.756814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:22.757511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:22.757957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:22.758373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:22.798164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d9101d80-55cb-427e-8d7b-9018d8a68631 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059171 Aug 05 05:25:22.798714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 515/1033] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:23.810797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:23.813029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:23.819843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:23.820331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:23.820768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:23.821452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:23.821923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:23.822321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:23.851739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-81e46325-127f-4ad3-a9e8-ddf4a91f8773 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Aug 05 05:25:23.852393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 519/1034] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:24.864478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:24.866660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:24.873708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:24.874215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:24.874639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:24.875328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:24.875781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:24.876355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:24.906097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4a0ecae0-8b6b-478a-a4af-e4d91bab8afd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Aug 05 05:25:24.906647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 516/1035] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:25.921854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:25.924837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:25.932208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:25.932680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:25.933106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:25.933817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:25.934259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:25.934697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:25.966368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fd16085b-21ab-4d6f-841b-dc9e65c308e0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050684 Aug 05 05:25:25.966937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 520/1036] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:26.981838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:26.985349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:26.996398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:26.997195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:26.997965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:26.999112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:26.999879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:27.000615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:27.032319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-017b95cf-ce42-4af0-bc64-d727a177ad51 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057323 Aug 05 05:25:27.032905 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 517/1037] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:28.045666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:28.047955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:28.055122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:28.055617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:28.056091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:28.056778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:28.057239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:28.057646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:28.087710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6843bc90-7eec-4755-970e-7a198f733217 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Aug 05 05:25:28.088302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 521/1038] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:29.104685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:29.108239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:29.118984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:29.119797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:29.120524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:29.121657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:29.122397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:29.123087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:29.155005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-53335217-2d85-4194-b223-fdb50006938c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057323 Aug 05 05:25:29.156022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 518/1039] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:30.171966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:30.175441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:30.186462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:30.187256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:30.188041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:30.189175 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:30.189919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:30.190616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:30.220381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7b2afaed-4684-40ba-82a4-2f953600e901 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055184 Aug 05 05:25:30.220934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 522/1040] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:31.240392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:31.243800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:31.252351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:31.252921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:31.253354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:31.254256 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:31.254693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:31.255365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:31.290872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7c8cfed9-2e18-4a86-a371-7fe84574f342 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061236 Aug 05 05:25:31.291413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 519/1041] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:32.307018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:32.310412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:32.320682 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:32.321164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:32.321595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:32.322282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:32.322727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:32.323146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:32.352114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-90ab1abf-9785-42d5-ba43-20bb7f1b4fc9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051966 Aug 05 05:25:32.352661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 523/1042] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:33.367388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:33.369508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:33.376535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:33.377023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:33.377454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:33.378147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:33.378596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:33.379069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:33.408617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-881fa310-0a85-4ca8-a7d2-d41494436dae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047640 Aug 05 05:25:33.409152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 520/1043] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:34.427144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:34.430705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:34.441569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:34.442373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:34.443088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:34.444338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:34.444942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:34.445354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:34.474728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b55655f0-1d47-4bf6-9a76-b3259cda0e8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054285 Aug 05 05:25:34.475725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 524/1044] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:35.490907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:35.493605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:35.500621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:35.501110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:35.501539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:35.502226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:35.502679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:35.503098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:35.532923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-69736528-79d6-468c-8eea-19c421acaa87 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Aug 05 05:25:35.533485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 521/1045] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:36.549253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:36.552770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:36.563757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:36.564617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:36.565338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:36.566467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:36.567186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:36.567981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:36.597259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-34d41f57-1e66-4e9f-b8f8-a81d03182860 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054759 Aug 05 05:25:36.597793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 525/1046] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:37.613824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:37.617209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:37.628129 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:37.628936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:37.629661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:37.630813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:37.631557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:37.632307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:37.661941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cad30abc-6dcf-4c7b-8117-4180102ac402 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055093 Aug 05 05:25:37.662486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 522/1047] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:38.674623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:38.677055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:38.684224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:38.684708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:38.685138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:38.685825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:38.686302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:38.686696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:38.715648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-91736c1c-f5a6-4d4e-bc7b-539bc7a59d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 05 05:25:38.716218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 526/1048] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:39.732636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:39.736213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:39.746303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:39.747365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:39.748144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:39.749257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:39.749996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:39.750685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:39.783364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8a25ba7e-e80b-4bd1-9a37-22a560fdd294 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057585 Aug 05 05:25:39.783936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 523/1049] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:40.798895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:40.802398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:40.810288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:40.810766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:40.811190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:40.811876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:40.812344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:40.812764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:40.843281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a7566849-cd15-4894-8495-7cf1ce6fda55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050988 Aug 05 05:25:40.843812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 527/1050] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:41.859332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:41.862845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:41.866648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:41.876013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:41.876810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:41.877513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:41.878751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:41.879487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:41.880219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:41.883875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:41.912102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5d81f1e0-a571-4ca0-9f69-c0268d9910b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059350 Aug 05 05:25:41.912658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 524/1051] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:42.928658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:42.931094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:42.938127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:42.938606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:42.939033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:42.939715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:42.940196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:42.940611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:42.942957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:42.971449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-62888e93-fb4e-458a-8a65-f725a91d002b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049161 Aug 05 05:25:42.972050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 528/1052] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:43.984516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:43.986778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:43.993640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:43.994142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:43.994575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:43.995263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:43.995713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:43.996166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:44.025900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-097b0ad4-62d8-4541-a100-8ee671de04f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Aug 05 05:25:44.026463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 525/1053] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:45.039171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:45.041576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:45.043799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:25:45.049602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:45.050081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:45.050515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:45.051198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:45.051647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:45.052093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:45.081915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5c419263-b8b7-45ba-8ec4-309fed61c618 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047208 Aug 05 05:25:45.082501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 529/1054] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:46.098037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:46.101636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:46.112575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:46.113331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:46.113993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:46.115166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:46.116246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:46.116949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:46.148004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-47bdf1e7-77a1-4090-9ac4-ca5450bbcacd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056678 Aug 05 05:25:46.148544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 526/1055] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:47.164962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:47.167138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:47.174064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:47.174540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:47.174973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:47.175672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:47.176186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:47.176613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:47.206001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7d51f2bf-6ebf-4295-80d3-1d679bf47cee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047677 Aug 05 05:25:47.206550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 530/1056] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:48.218544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:48.220753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:48.227533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:48.228046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:48.228473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:48.229152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:48.229595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:48.230010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:48.259248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dcd04ce8-2313-4374-a44a-0c5fef716540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Aug 05 05:25:48.260051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 527/1057] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:49.271022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:49.273171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:49.280384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:49.280871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:49.281301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:49.281987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:49.282431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:49.282848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:49.312594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e6580435-028e-4e81-bbe5-6871538a3c23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045675 Aug 05 05:25:49.313145 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 531/1058] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:50.325313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:50.327568 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:50.334351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:50.334838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:50.335267 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:50.335996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:50.336444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:50.336845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:50.365909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a4e4fb92-6ab2-4c7c-a07d-4bd5de535534 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Aug 05 05:25:50.366445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 528/1059] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:51.382683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:51.386198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:51.401889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:51.402379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:51.402814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:51.403513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:51.405502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:51.405931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:51.442657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1ab24cd3-87b4-4a3d-bd13-2c9acdc25468 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066821 Aug 05 05:25:51.443233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 532/1060] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:52.455463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:52.457646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:52.464358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:52.464845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:52.465282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:52.465968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:52.466409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:52.466825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:52.496664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4bd5fc9b-761c-4c63-aa6a-ffc740a16e6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Aug 05 05:25:52.497225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 529/1061] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:53.513559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:53.517168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:53.527184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:53.527664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:53.528133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:53.528815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:53.529263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:53.529670 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:53.561005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-79ba5b83-2fc6-40e8-8006-5f63c9f7dde9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054260 Aug 05 05:25:53.561559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 533/1062] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:54.575510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:54.577696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:54.588900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:54.589382 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:54.589810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:54.590493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:54.590933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:54.591346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:54.621013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3055938a-65e6-4f37-8662-9a3e6f4437e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050001 Aug 05 05:25:54.621473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 530/1063] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:55.637667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:55.641232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:55.651263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:55.651742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:55.652204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:55.652876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:55.653324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:55.653741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:55.684256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-26d1d990-6ed2-403f-a366-06a1e94add57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053320 Aug 05 05:25:55.684816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 534/1064] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:56.701062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:56.704587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:56.714376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:56.714861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:56.715296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:56.716023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:56.716477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:56.716898 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:56.746743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-87a6e13a-7557-4b6d-add2-cbb9104b9965 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052398 Aug 05 05:25:56.747205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 531/1065] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:57.762436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:57.766128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:57.777113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:57.777899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:57.778602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:57.779722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:57.780896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:57.781634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:57.814223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d2f667ab-7d18-4232-9b7c-2b5a436d377e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058573 Aug 05 05:25:57.814767 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 535/1066] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:58.831035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:58.834442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:58.842422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:58.842913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:58.843351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:58.844083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:58.844536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:58.844953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:58.874514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cbf72544-6d6a-4d25-b6a9-b1c550cfdd7d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050314 Aug 05 05:25:58.875465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 532/1067] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:25:59.893893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:25:59.897355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:25:59.909113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:59.909961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:59.910606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:59.911757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:25:59.912568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:25:59.913236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:25:59.944504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-368607d8-be3e-4008-b61f-b7cfaf4a06ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057626 Aug 05 05:25:59.945051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 536/1068] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:25:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:00.961239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:00.964743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:00.972030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:00.972513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:00.972952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:00.973634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:00.974075 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:00.974486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:01.006435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-af050652-7fdb-4b0b-bc98-768502d2b17b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051931 Aug 05 05:26:01.006998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 533/1069] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:02.020327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:02.022538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:02.029576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:02.030431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:02.030866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:02.031555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:02.032126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:02.032550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:02.062414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d2aa8708-b1b2-410f-945d-ce31bb0b9966 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Aug 05 05:26:02.062971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 537/1070] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:03.079198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:03.082721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:03.093262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:03.093754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:03.094187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:03.094887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:03.095347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:03.095787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:03.125083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-47c4b957-fa6a-4069-97c1-943b30bee829 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052560 Aug 05 05:26:03.125664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 534/1071] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:04.140419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:04.142610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:04.149732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:04.150216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:04.150646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:04.151322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:04.151793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:04.152225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:04.182987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2fd08f5c-a838-4c6a-8504-a70c6d6f5a28 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047948 Aug 05 05:26:04.183555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 538/1072] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:05.199201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:05.203561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:05.214328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:05.214806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:05.215233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:05.215952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:05.216447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:05.216863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:05.246421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6b3b0e8-7ed4-4386-8d5c-e6be11926058 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053829 Aug 05 05:26:05.246973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 535/1073] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:06.258857 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:06.261091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:06.268004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:06.268491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:06.268925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:06.269626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:06.270060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:06.270478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:06.300095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-138c9536-1fd3-4a1d-8679-7a4cf5b8181e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Aug 05 05:26:06.300640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 539/1074] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:07.312726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:07.314894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:07.321464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:07.321947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:07.322376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:07.323061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:07.323508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:07.323964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:07.353155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-727e60c1-ceb6-41e0-a141-60b60e679a15 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 05 05:26:07.353693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 536/1075] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:08.370286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:08.373798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:08.380918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:08.381419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:08.381869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:08.382580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:08.383047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:08.383483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:08.414190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-856f54af-a79e-4aa6-91ae-9ba4ae1e6f1a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Aug 05 05:26:08.414728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 540/1076] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:09.431200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:09.434701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:09.444817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:09.445615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:09.446345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:09.447473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:09.448266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:09.448976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:09.479266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-708e5e4b-f291-4bae-8ec7-b2b223eadc23 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055174 Aug 05 05:26:09.479808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 537/1077] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:10.496059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:10.499166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:10.505789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:10.506265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:10.506688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:10.507368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:10.507936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:10.508352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:10.537507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6f100083-3c0f-4aa6-93f2-f0cecca26882 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048395 Aug 05 05:26:10.538056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 541/1078] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:11.555680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:11.559197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:11.566741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:11.567221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:11.567650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:11.568369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:11.568818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:11.569233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:11.598376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-af88899e-f88e-4b2b-9093-f948fdaf26e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049305 Aug 05 05:26:11.598910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 538/1079] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:12.615267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:12.618786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:12.629765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:12.630556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:12.631271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:12.632456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:12.633193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:12.633886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:12.665497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-940d19ad-ad9d-490f-8089-0c78386b0454 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057038 Aug 05 05:26:12.666034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 542/1080] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:13.679258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:13.681578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:13.684051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=30 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:13.689777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:13.690286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:13.690691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:13.691388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:13.691873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:13.692293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:13.694825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=90 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:13.722775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7ecf86dd-6052-4104-afc9-1829a73b6162 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Aug 05 05:26:13.723238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 539/1081] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:14.739402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:14.742913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:14.754403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:14.755087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:14.755783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:14.756955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:14.757691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:14.758387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:14.762245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=90 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:14.791231 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ee427194-4972-4c27-b2e5-16f22cd91a95 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059091 Aug 05 05:26:14.791802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 543/1082] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:15.807510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:15.810995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:15.821833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:15.822625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:15.823332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:15.824521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:15.825271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:15.826007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:15.855193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c4f9598e-5969-4f9b-bf62-ce7fa075ff29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054473 Aug 05 05:26:15.855730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 540/1083] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:16.872578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:16.874939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:16.877348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:26:16.882830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:16.883324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:16.883752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:16.884471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:16.884913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:16.885324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:16.915594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d0032dfb-cddd-4fe2-8a4b-a111c1a50ba7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 Aug 05 05:26:16.916185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 544/1084] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:17.932341 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:17.936051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:17.942781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:17.943258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:17.943689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:17.944402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:17.944847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:17.945261 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:17.974683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-baaae3cd-9e18-4c84-b4ea-05a127d1ab49 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049152 Aug 05 05:26:17.975233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 541/1085] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:18.991559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:18.995151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:19.005863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:19.006684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:19.007422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:19.009000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:19.009752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:19.010427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:19.041873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9474117f-41af-490e-8df6-4334ee153a12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057042 Aug 05 05:26:19.042415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 545/1086] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:20.054901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:20.057101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:20.063996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:20.064480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:20.064908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:20.065580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:20.066020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:20.066429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:20.095969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0aba63f3-4b71-4a60-b0fc-f71d5b6d81ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Aug 05 05:26:20.096480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 542/1087] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:21.111569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:21.113757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:21.120868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:21.121348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:21.121804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:21.122480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:21.122950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:21.123363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:21.152220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7c184b75-9853-4e60-b533-b32a1c6e8272 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Aug 05 05:26:21.152758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 546/1088] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:22.169128 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:22.172676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:22.183465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:22.184318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:22.185035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:22.186168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:22.186975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:22.187456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:22.218875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ce75f578-de8f-49a5-8f6a-9d2fcbac7f61 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056355 Aug 05 05:26:22.219426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 543/1089] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:23.236500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:23.238912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:23.246323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:23.246897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:23.247374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:23.248193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:23.248668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:23.249155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:23.281279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fcd0a116-6673-4b05-a2d1-564b2b34c44c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051235 Aug 05 05:26:23.282265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 547/1090] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:24.297068 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:24.299370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:24.306339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:24.306827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:24.307260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:24.307993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:24.308447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:24.308874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:24.340998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-464e7d64-4a20-4a09-b2aa-0501b8278833 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050351 Aug 05 05:26:24.341931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 544/1091] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:25.359126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:25.363717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:25.375447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:25.376376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:25.376889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:25.377592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:25.378045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:25.378458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:25.408691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-50534523-5429-4b5a-8414-c0bd3d306c1e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056213 Aug 05 05:26:25.409246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 548/1092] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:26.425392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:26.428917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:26.439546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:26.440531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:26.441239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:26.442366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:26.443102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:26.443862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:26.476910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-58d88a46-5036-4abb-b6bb-af5f854db522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058347 Aug 05 05:26:26.477448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 545/1093] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:27.493691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:27.497057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:27.511071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:27.511558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:27.512028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:27.512736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:27.513185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:27.513637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:27.544207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-98bd4b38-f253-4f20-a6cd-906749f60149 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057425 Aug 05 05:26:27.544766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 549/1094] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:28.561025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:28.564561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:28.575395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:28.576259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:28.576979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:28.578109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:28.578853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:28.579666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:28.609552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eb41eac6-dfba-4a54-83ca-046b1ca0010a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055300 Aug 05 05:26:28.610290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 546/1095] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:29.622041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:29.624295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:29.631201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:29.631694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:29.632178 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:29.632870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:29.633307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:29.633956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:29.663442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-13f8dae5-9a89-4549-b725-d4f44e7ad31f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Aug 05 05:26:29.664043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 550/1096] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:30.677774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:30.680001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:30.686823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:30.687301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:30.687722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:30.688436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:30.688874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:30.689286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:30.719146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-66a95312-2d9c-43e7-9548-a08a4b376118 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Aug 05 05:26:30.719659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 547/1097] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:31.730706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:31.732999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:31.739950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:31.740434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:31.740866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:31.741554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:31.741999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:31.742420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:31.772002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-756e1adb-7e22-4b8f-8555-30ce0218375f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Aug 05 05:26:31.772554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 551/1098] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:32.788139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:32.790975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:32.801700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:32.802502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:32.803221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:32.804403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:32.805151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:32.805851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:32.839052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f8f661ff-23bb-4f46-8b9d-114ccee89ef0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057117 Aug 05 05:26:32.839599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 548/1099] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:33.195319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:26:33.195671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:26:33.856127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:33.859709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:33.867734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:33.868263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:33.868709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:33.869385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:33.869837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:33.870261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:33.899796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8dd62810-75c7-4158-be1b-6d6a76d16851 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050354 Aug 05 05:26:33.900383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 552/1100] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:34.918578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:34.922364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:34.932492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:34.933284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:34.933995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:34.935122 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:34.935884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:34.936607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:34.967962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a076b94c-f5d3-40d4-923d-fa3c823805a4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057816 Aug 05 05:26:34.968510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 549/1101] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:35.429706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:35.430256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:35.436800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:35.437280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:35.437713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:35.438401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:35.438846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:35.439284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:35.581134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lazy-loading 'services' on Instance uuid b5caff55-2233-4dbd-8296-3b018d176171 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:26:35.658101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7e60f952-0f21-496b-bfab-9fbece3e8a3a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171/os-volume_attachments/33819fd0-9ccb-47f7-b771-63faa6e87833" status: 202 len: 0 microversion: 2.1 time: 0.232241 Aug 05 05:26:35.658714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 553/1102] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:26:35 2022] DELETE /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171/os-volume_attachments/33819fd0-9ccb-47f7-b771-63faa6e87833 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:26:35.984514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:26:35.987839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:35.994432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:35.994918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:35.995341 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:35.996056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:35.996502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:35.996917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:36.026207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cf4799dd-8e2a-420e-9b91-25dc644a475a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Aug 05 05:26:36.026734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 550/1103] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:26:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:26:37.041648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:26:37.044131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:26:37.051505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:37.052078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:37.052583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:37.053312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:26:37.053795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:26:37.054252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:26:37.156433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e514170a-1502-4ce3-a8ce-aac083e2e6f3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/action" status: 200 len: 41422 microversion: 2.1 time: 0.119537 Aug 05 05:26:37.157426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 554/1104] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:26:37 2022] POST /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf/action => generated 41422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 05:26:41.979547 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:26:41.980513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:27:01.925014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:27:01.925879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:27:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:28:21.360711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:28:21.360711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:28:21.506807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:28:21.507684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:29:53.209016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:29:53.209725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:30:01.991333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:30:01.992265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:30:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:30:21.937427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:30:21.938648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:31:41.381754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:31:41.382767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:31:41.520712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:31:41.521505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:31:59.110843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:31:59.111892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:32:35.631716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 05:32:35.636268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:35.636754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:35.638798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=23 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:32:35.639434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=71 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:32:35.644674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:35.645221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:35.645673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:35.646363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:35.646835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:35.647237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:35.673446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:32:35.754855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7ef8fb73-5a89-4598-9644-5f16bb565720 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 204 len: 0 microversion: 2.1 time: 0.124754 Aug 05 05:32:35.755404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 551/1105] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:32:35 2022] DELETE /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:32:35.762641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a0560d8-b404-4c31-b1a2-75d2f7d1e20c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 05:32:35.763309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=21 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:32:35.764124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:32:35.768271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:35.768970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:35.777771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:35.778247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:35.778675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:35.779357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:35.779830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:35.780253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:36.026829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:36.035183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e858fe52-5bac-4684-8ceb-56463e6154dd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.274736 Aug 05 05:32:36.035742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 555/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:35 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:37.061393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:37.062447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:37.073364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:37.073867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:37.074285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:37.074966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:37.075433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:37.075868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:37.082741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56516. Aug 05 05:32:37.262567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:37.274982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-450e600c-8380-40ad-8d9a-eb922e01f45a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.220483 Aug 05 05:32:37.275776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 552/1107] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:37 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:37.819368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:37.819928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:37.833450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a0560d8-b404-4c31-b1a2-75d2f7d1e20c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56526. Aug 05 05:32:37.835911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:37.836444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:37.836997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:37.837672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:37.838127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:37.838553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:37.865143 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:32:37.946262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a6d38c67-6b0a-4fc7-88a9-5ec75ae4416a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 204 len: 0 microversion: 2.1 time: 0.130584 Aug 05 05:32:37.946831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 556/1108] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:32:37 2022] DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:32:37.957100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:37.957705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:37.963702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:37.964213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:37.964637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:37.965315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:37.965753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:37.966183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:38.101287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:38.109557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a41ffaf2-9060-4bdc-83e2-1fa4e9836989 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1726 microversion: 2.1 time: 0.157639 Aug 05 05:32:38.110112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 553/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:38.306044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:38.307041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:38.317684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:38.318493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:38.319209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:38.320394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:38.321172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:38.321842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:38.457221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:38.469876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bb5367d2-6ead-4e53-a6b4-a2bebdec29a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171052 Aug 05 05:32:38.470578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 557/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:38 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:39.131745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:39.132343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:39.139015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:39.139496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:39.139973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:39.140662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:39.141111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:39.141523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:39.339527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:39.348114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-59c0196a-f3a5-4b53-b366-38a61dc53222 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1726 microversion: 2.1 time: 0.220386 Aug 05 05:32:39.348923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 554/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:39.493202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:39.493947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:39.500753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:39.501238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:39.501662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:39.502326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:39.502775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:39.503186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:39.719421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:39.728081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-05bbeec4-b2c2-4522-b942-4562c720303d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.238861 Aug 05 05:32:39.728623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 558/1112] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:39 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:39.851990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-8d7edf8f-30cd-4c36-b4f0-bacc9bcc25b0 req-5d7697b8-11ec-4ccc-b98f-e0dd9813452e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e365c429-240d-4397-a002-eae5c51453cf", "name": "network-vif-deleted", "tag": "b74342d7-9a40-4a69-97ff-c95f0cd0f890"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:32:39.862203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8d7edf8f-30cd-4c36-b4f0-bacc9bcc25b0 req-5d7697b8-11ec-4ccc-b98f-e0dd9813452e service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:39.862762 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8d7edf8f-30cd-4c36-b4f0-bacc9bcc25b0 req-5d7697b8-11ec-4ccc-b98f-e0dd9813452e service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:39.863270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-8d7edf8f-30cd-4c36-b4f0-bacc9bcc25b0 req-5d7697b8-11ec-4ccc-b98f-e0dd9813452e service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:39.875872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-8d7edf8f-30cd-4c36-b4f0-bacc9bcc25b0 req-5d7697b8-11ec-4ccc-b98f-e0dd9813452e service nova] Creating event network-vif-deleted:b74342d7-9a40-4a69-97ff-c95f0cd0f890 for instance e365c429-240d-4397-a002-eae5c51453cf on hv-cinder-81558 Aug 05 05:32:39.881028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-8d7edf8f-30cd-4c36-b4f0-bacc9bcc25b0 req-5d7697b8-11ec-4ccc-b98f-e0dd9813452e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097643 Aug 05 05:32:39.882023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 555/1113] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:32:40.369652 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:40.370169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:40.376982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:40.377465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:40.377892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:40.378563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:40.379003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:40.379420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:40.441159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:40.450013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f87b393a-d8fe-4e05-899a-317711ac6ed7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084400 Aug 05 05:32:40.450602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 559/1114] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:40.750640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:40.751489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:40.759918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:40.760397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:40.761193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:40.761495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:40.761951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:40.762331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:40.898580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:40.906970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-614b6bc6-b674-4d8a-83a4-291a05d65b82 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161139 Aug 05 05:32:40.907501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 556/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:40 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:41.475755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:41.476513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:41.484508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:41.485074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:41.485581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:41.486387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:41.486912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:41.487441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:41.557079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:41.565347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-27c56d02-3e25-4394-806c-5666dbfb2346 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096736 Aug 05 05:32:41.565915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 560/1116] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:41.932540 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:41.933531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:41.944431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:41.945237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:41.945948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:41.947073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:41.947851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:41.948556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:42.089362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:42.097794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-263dc280-029e-4004-92fb-a5310fb1a064 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172044 Aug 05 05:32:42.098342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 557/1117] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:41 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:42.587990 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:42.588686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:42.596570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:42.597133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:42.597612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:42.598429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:42.598951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:42.599439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:42.666181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:42.674784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f41a6047-ed8a-4e49-921d-c4ce00b0b3fe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091547 Aug 05 05:32:42.675345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 561/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:43.120309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:43.120855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:43.129881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:43.130669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:43.131381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:43.132256 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:43.132702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:43.133118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:43.273018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:43.285262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5fc6686c-c5a7-46bc-b395-fa0e7a90ae68 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169244 Aug 05 05:32:43.286011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 558/1119] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:43 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:43.700302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:43.701308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:43.712371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:43.713177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:43.713891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:43.715026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:43.715833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:43.716568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:43.781424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:43.789858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6d179bd2-ec7c-4938-b327-1f141f01aa1f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096321 Aug 05 05:32:43.790428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 562/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:44.312316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:44.313200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:44.324585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:44.325378 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:44.326085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:44.327209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:44.327986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:44.328676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:44.465020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:44.473255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eecb292e-b7ff-4047-b16c-73526256451f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167553 Aug 05 05:32:44.473826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 559/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:44 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:44.814921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:44.815891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:44.826660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:44.827464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:44.828262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:44.829394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:44.830137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:44.830836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:44.893421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:44.902126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3c4ac112-89f2-4ed9-b79f-67a3cc810ef9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093819 Aug 05 05:32:44.902693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 563/1122] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:45.497781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:45.498813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:45.508091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:45.508593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:45.509018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:45.509701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:45.510144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:45.510556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:45.642561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:45.653298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-672d4e73-f2be-4777-be53-abddc3013070 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161890 Aug 05 05:32:45.653879 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 560/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:45 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:45.926745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:45.927823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:45.942245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:45.945296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:45.947069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:45.948176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:45.948685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:45.949151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:46.017266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:46.025953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d0038dbb-5a31-4f3b-a033-ff9f28ecc66f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105807 Aug 05 05:32:46.026519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 564/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:46.678633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:46.679704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:46.690667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:46.691471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:46.692243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:46.693387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:46.694234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:46.694675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:46.836397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:46.844974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-343eb637-264c-47f2-ae1d-cf3697053c59 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172932 Aug 05 05:32:46.845550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 561/1125] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:46 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:47.048773 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:47.049502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:47.057061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:47.057552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:47.057980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:47.058667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:47.059116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:47.059538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:47.128686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:47.136875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d88a0e0c-cdcc-484e-9640-28652aa0c8db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092823 Aug 05 05:32:47.137433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 565/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:47.870418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:47.871406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:47.882287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:47.883077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:47.883825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:47.884900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:47.885680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:47.886368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:48.033131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:48.041376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4c1c82d9-7699-42d2-81c2-56c899a6ba1b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.177620 Aug 05 05:32:48.041945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 562/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:47 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:48.162072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:48.163138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:48.170123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:48.170605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:48.171038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:48.171731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:48.172212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:48.172633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:48.238544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:48.246669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c70365a2-ff2f-4110-b57e-4abac490d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091150 Aug 05 05:32:48.247230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 566/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:49.062990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:49.063527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:49.070454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:49.070924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:49.071347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:49.072073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:49.072508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:49.072918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:49.213092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:49.225346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dc970ff7-2c74-4adf-b04e-1879a7ea9d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166051 Aug 05 05:32:49.225983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 563/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:49 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:49.267715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:49.268388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:49.275601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:49.276110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:49.276548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:49.277242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:49.277695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:49.278125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:49.350801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:49.359475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ec1959ad-d8d4-4c53-b6d0-14bbffc703e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095693 Aug 05 05:32:49.360086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 567/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:50.250873 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:50.251939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:50.262853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:50.263653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:50.264429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:50.265557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:50.266296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:50.266988 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:50.382727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:50.383440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:50.390339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:50.390815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:50.391238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:50.391980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:50.392425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:50.392843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:50.402804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:50.410895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-12cf2c6f-14af-446f-a8fa-aabb6a09136b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166504 Aug 05 05:32:50.411451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 564/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:50 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:50.454467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:50.462549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5a20d78f-6441-4a35-b120-2afc020fafe4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.083745 Aug 05 05:32:50.463083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 568/1132] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:51.436499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:51.437424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:51.446852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:51.447333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:51.447781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:51.448509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:51.448959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:51.449378 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:51.482604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:51.483188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:51.490188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:51.490670 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:51.491093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:51.491753 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:51.492230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:51.492640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:51.572016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:51.575603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:32:51.581340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-36f2b3dc-4598-4c43-8dc9-e3bc0509b449 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.102592 Aug 05 05:32:51.581917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 569/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:51.601269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:51.609768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-380c50a2-537c-480f-8da8-5d10f4b58416 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.179759 Aug 05 05:32:51.610313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 565/1134] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:51 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:52.606704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:52.607438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:52.617560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:52.618034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:52.618464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:52.619150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:52.619605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:52.620112 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:52.630912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:52.631574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:52.638259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:52.638747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:52.639168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:52.639894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:52.640336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:52.640752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:52.659356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:32:52.694026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:52.702164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-147c833d-4564-45f4-846c-fcbb70db2146 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101932 Aug 05 05:32:52.702746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 570/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:52.777430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:52.785357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-67a9dcb3-872b-45ff-83cc-05f2c2a998e7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158317 Aug 05 05:32:52.785904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 566/1136] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:52 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:53.726650 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:53.727405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:53.735934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:53.736529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:53.737071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:53.737918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:53.738538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:53.739055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:53.806570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:53.807018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:53.807225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:53.813957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:53.814425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:53.814849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:53.815530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:53.815677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-81368d63-d2c2-46ac-8297-ebd015246a07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095210 Aug 05 05:32:53.816011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:53.816948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 571/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:53.817114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:53.948751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:53.956908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6b13c1c3-e74c-4eba-8330-7829e830ac0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154367 Aug 05 05:32:53.957477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 567/1138] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:53 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:32:54.840101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:54.841098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:54.851981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:54.852766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:54.853515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:54.854596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:54.855337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:54.856078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:54.920864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:54.929226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-514530e9-b534-4957-af0c-f8ff0190d06b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095762 Aug 05 05:32:54.929784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 572/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:54.978695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:54.979285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:54.987753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:54.988433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:54.988956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:54.989862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:54.990417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:54.990948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:55.126662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:55.134973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9e9b4b1e-d673-481a-a52c-eb7de7235ec6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160372 Aug 05 05:32:55.135511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 568/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:55.958127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:55.958803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:55.966770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:55.967312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:55.967803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:55.968607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:55.969103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:55.969573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:56.034876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:56.043304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8f29178f-e722-4532-9959-59571e58398b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089695 Aug 05 05:32:56.043910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 573/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:56.160077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:56.161035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:56.172114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:56.172895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:56.173603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:56.174724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:56.175461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:56.176215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:56.305193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:56.313632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4e615e3a-ed92-4b31-af0c-7b988bb99929 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159935 Aug 05 05:32:56.314190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 569/1142] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:57.065286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:57.065879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:57.072845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:57.073329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:57.073771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:57.074548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:57.074997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:57.075454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:57.141027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:57.149973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-95048646-426f-4bd2-98c6-9e3e05faa76d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088547 Aug 05 05:32:57.150762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 574/1143] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:57.338472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:57.339087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:57.349237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:57.350010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:57.350701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:57.351405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:57.351881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:57.352304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:57.495796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:57.503840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-98f324b9-514a-42d1-88a6-5b03a3b1f4e6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171407 Aug 05 05:32:57.504446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 570/1144] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:57 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:58.176595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:58.177742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:58.188650 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:58.189443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:58.190159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:58.191327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:58.192129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:58.192826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:58.254288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:58.262673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-14192b1a-9b43-4c9f-ad28-cc21aa4cd990 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092686 Aug 05 05:32:58.263244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 575/1145] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:58.530412 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:58.532419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:58.543433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:58.544296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:58.545019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:58.546123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:58.546901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:58.547596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:58.684238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:58.694458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-696dd9a6-29ee-4ea3-b17d-9fb5f32a2a64 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170788 Aug 05 05:32:58.695148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 571/1146] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:58 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:59.290906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:59.292018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:59.302812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:59.303614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:59.304406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:59.305701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:59.306156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:59.306590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:59.380748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:59.390042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a061ded2-b9a6-49e4-ac33-7d2c43d8e184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105941 Aug 05 05:32:59.390576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 576/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:32:59.719971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:32:59.720978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:32:59.732005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:59.732483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:59.732901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:59.733661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:32:59.734113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:32:59.734526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:32:59.871516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:32:59.883969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5044e5e6-b8ec-4b4c-828e-43ea904b4262 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170222 Aug 05 05:32:59.884753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 572/1148] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:32:59 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:00.415570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:00.416254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:00.423796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:00.424332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:00.424811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:00.425572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:00.426078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:00.426542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:00.492458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:00.503576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8b0ec6b2-72a8-458d-baaa-759d770fcae4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094367 Aug 05 05:33:00.504178 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 577/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:00.912955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:00.913763 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:00.920893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:00.921376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:00.921807 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:00.922491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:00.922942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:00.923362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:01.053140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:01.061582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-44a64be6-0e3d-4d99-8204-5488598ab4ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.153937 Aug 05 05:33:01.062146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 573/1150] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:01.528653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:01.529488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:01.538383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:01.539022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:01.539707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:01.540611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:01.541216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:01.541781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:01.606049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:01.614263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bbc0d371-2fba-42e1-b2d2-620bbfa2ed8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091822 Aug 05 05:33:01.614829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 578/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:02.086900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:02.087646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:02.096138 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:02.096747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:02.097286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:02.098153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:02.098716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:02.099237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:02.252361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:02.260604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-94651596-b2fb-4a8d-aa20-18d97353fca8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.180158 Aug 05 05:33:02.261097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 574/1152] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:02.637451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:02.638052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:02.645155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:02.645663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:02.646117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:02.646856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:02.647700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:02.648172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:02.717281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:02.725881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-830308ab-559d-4046-959f-09da9ac43b45 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093671 Aug 05 05:33:02.726458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 579/1153] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:03.286402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:03.287405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:03.295143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:03.295620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:03.296097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:03.296774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:03.297211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:03.297623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:03.431691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:03.440144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5a972245-75ef-4a96-bd3e-34fbb3730ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160289 Aug 05 05:33:03.440690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 575/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:03 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:03.751289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:03.752311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:03.763067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:03.763922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:03.764632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:03.765731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:03.766465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:03.767159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:03.834390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:03.842668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5c7a54a3-c21a-4396-aee5-d34ac1a484a3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097984 Aug 05 05:33:03.843242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 580/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:04.464438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:04.465058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:04.472234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:04.472721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:04.473153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:04.473856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:04.474324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:04.474732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:04.605493 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:04.614093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-775f3ff5-c213-4fad-af4d-ebd8cdd6fa6a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154888 Aug 05 05:33:04.614669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 576/1156] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:04 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:04.867298 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:04.867910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:04.878188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:04.878781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:04.879381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:04.880389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:04.880956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:04.881567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:04.944268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:04.952593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c4ebc379-efee-4f07-814f-1381b34066d9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091765 Aug 05 05:33:04.953158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 581/1157] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:05.639618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:05.640526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:05.651902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:05.652687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:05.653392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:05.654514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:05.655261 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:05.656007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:05.800104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:05.808902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8f5a7327-d8fb-4392-af19-95496276dd69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175943 Aug 05 05:33:05.809477 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 577/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:05 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:05.977099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:05.978135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:05.981917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:05.990673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:05.991441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:05.992216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:05.993300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:05.993751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:05.994172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:06.056643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:06.064754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3e35835a-4414-4d59-a0e4-16cdaf10244d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094228 Aug 05 05:33:06.065331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 582/1159] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:06.830328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:06.830959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:06.833349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:06.839838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:06.840658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:06.841300 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:06.842424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:06.843132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:06.843734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:06.979563 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:06.987848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fa8cc3a7-414c-4663-b162-59897fa83f10 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161429 Aug 05 05:33:06.988401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 578/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:06 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:07.096241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:07.097071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:07.106621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:07.107096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:07.107505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:07.108242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:07.108685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:07.109102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:07.183319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:07.193195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-67969a97-926c-4c79-9267-7fb5c511c416 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.102332 Aug 05 05:33:07.193794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 583/1161] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:08.012503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:08.013512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:08.024526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:08.025326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:08.026037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:08.026735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:08.027185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:08.027605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:08.169135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:08.181344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-65a91256-d31a-4e05-ac71-63b48f4cc637 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175233 Aug 05 05:33:08.182162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 579/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:08 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:08.215690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:08.216346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:08.222862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:08.223343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:08.223794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:08.224504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:08.224936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:08.225350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:08.287586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:08.300210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9fbd6ae6-cb9b-47ea-af2d-880ddfe0ff6a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089558 Aug 05 05:33:08.300958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 584/1163] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:09.207056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:09.208050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:09.219118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:09.219974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:09.220694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:09.221825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:09.222564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:09.223298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:09.322973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:09.323608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:09.330836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:09.331321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:09.331749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:09.332508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:09.332953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:09.333372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:09.609110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:09.617441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e981d49e-eae8-4aeb-b908-8fb60b76c729 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.298612 Aug 05 05:33:09.617984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 585/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:09.664000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:09.672292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c5eb9ade-424d-48d7-b39b-aee36ea62ac3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.471894 Aug 05 05:33:09.672858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 580/1165] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:09 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:10.643491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:10.644516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:10.656502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:10.657300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:10.658015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:10.659151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:10.660480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:10.661233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:10.681155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:10.693613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:10.694191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:10.701070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:10.701550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:10.701976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:10.702662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:10.703106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:10.703518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:10.727915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:10.736561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9c5e0288-2520-49fc-98c1-bdef220a7b02 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.100020 Aug 05 05:33:10.737135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 586/1166] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:10.841285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:10.849250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0f8cf327-5349-4dbb-8f69-f050aaafc9cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159529 Aug 05 05:33:10.849925 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 581/1167] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:10 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:11.761243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:11.762210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:11.773628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:11.774422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:11.775152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:11.776156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:11.776606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:11.777034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:11.838807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:11.847114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d148a5e9-768b-402d-b64a-2385ff2744c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092513 Aug 05 05:33:11.847655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 587/1168] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:11.870619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:11.871222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:11.878070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:11.878544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:11.878995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:11.879672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:11.880143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:11.880559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:12.011718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:12.021695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bea1fc77-6833-4513-bb24-203c8ad216f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154698 Aug 05 05:33:12.022745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 582/1169] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:11 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:12.877980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:12.878964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:12.888232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:12.888603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:12.889030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:12.889717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:12.890194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:12.890563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:12.963801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:12.972615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8b07e320-7ab2-4152-9156-46421a57e335 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101199 Aug 05 05:33:12.973195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 588/1170] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:13.044055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:13.044640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:13.051478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:13.052001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:13.052468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:13.053151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:13.053605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:13.054021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:13.058040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:13.191758 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:13.200282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5c315c9c-cc9f-4522-8039-ca9a04b7c2d5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160226 Aug 05 05:33:13.200833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 583/1171] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:13 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:13.220317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:33:13.220500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:33:13.999457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:14.000478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:14.011408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:14.012251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:14.012919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:14.014092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:14.014827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:14.015518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:14.080330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:14.088454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-285e51a7-5fbb-4bb0-8af7-a32982ef5da6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095460 Aug 05 05:33:14.089020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 589/1172] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:14.225479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:14.226397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:14.237398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:14.238192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:14.238907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:14.240115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:14.240853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:14.241543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:14.381259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:14.390933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3f442dc3-ac45-49ce-b137-f7680acc0ce4 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172108 Aug 05 05:33:14.391496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 584/1173] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:14 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:15.108866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:15.109466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:15.116230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:15.116737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:15.117152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:15.117843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:15.118289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:15.118713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:15.186684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:15.195094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2e5b5b14-2f8c-4526-b899-93b601cb8926 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090335 Aug 05 05:33:15.195734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 590/1174] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:15.412777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:15.413404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:15.420367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:15.420848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:15.421255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:15.421965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:15.422405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:15.422825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:15.554476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:15.563045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-362c4dc4-2c02-4c68-b952-463dec895711 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154349 Aug 05 05:33:15.563650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 585/1175] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:15 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:16.216429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:16.217070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:16.224296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:16.224789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:16.225221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:16.225908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:16.226463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:16.227015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:16.292847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:16.301111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b732de3e-1f13-435a-82f4-e57e57b5305d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088772 Aug 05 05:33:16.301696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 591/1176] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:16.584141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:16.584757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:16.591452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:16.591970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:16.592401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:16.593087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:16.593532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:16.593951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:16.738050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:16.750322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e5492673-155a-4336-8154-dedfcb63067d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170247 Aug 05 05:33:16.750880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 586/1177] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:16 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:17.323359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:17.324022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:17.330961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:17.331416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:17.332000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:17.332680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:17.333122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:17.333532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:17.401821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:17.410764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a736bebf-590e-48a0-9f3d-b6e213f33176 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092137 Aug 05 05:33:17.411492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 592/1178] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:17.771698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:17.772797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:17.779744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:17.780260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:17.780688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:17.781377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:17.781821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:17.782241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:17.919360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:17.931744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8688fe7d-9c0c-4b0d-8b5b-9cdc657439a2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163705 Aug 05 05:33:17.932862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 587/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:17 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:18.432514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:18.433155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:18.440020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:18.440504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:18.440939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:18.441630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:18.442076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:18.442499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:18.513354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:18.523681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a79da726-a1a9-43e2-beb6-303a22cfa85f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094841 Aug 05 05:33:18.524592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 593/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:18.955304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:18.955910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:18.962777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:18.963341 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:18.963796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:18.964501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:18.964950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:18.965369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:19.098450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:19.106681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-00674439-0662-4615-9cad-af3955e0296e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.155446 Aug 05 05:33:19.107274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 588/1181] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:18 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:19.550481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:19.551102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:19.558115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:19.558600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:19.559037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:19.559748 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:19.560235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:19.560661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:19.627229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:19.635946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fc1545a3-f2ed-4287-bcb5-667f7fcef22a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089429 Aug 05 05:33:19.636513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 594/1182] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:20.127183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:20.127832 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:20.134674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:20.135154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:20.135590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:20.136324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:20.136776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:20.137194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:20.265451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:20.273998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f064de61-b30c-4038-b5ec-671f59fe2bd8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.150804 Aug 05 05:33:20.274577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 589/1183] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:20 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:20.657943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:20.658532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:20.665283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:20.665759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:20.666273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:20.666960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:20.667401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:20.667818 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:20.738671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:20.753605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eaf1989c-cc7e-45f4-8420-bcb7ad4cabbb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099713 Aug 05 05:33:20.754187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 595/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:21.299091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:21.300035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:21.310830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:21.311627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:21.312415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:21.313546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:21.314290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:21.314996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:21.462814 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:21.471510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bb612ca5-b9ad-4215-a184-5d85af6b12e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.179181 Aug 05 05:33:21.472100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 590/1185] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:21 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:21.779159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:21.780134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:21.791132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:21.791985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:21.792705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:21.793861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:21.794608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:21.795503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:21.862021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:21.874853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-29613f28-7772-410e-b340-9d60203555e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.102714 Aug 05 05:33:21.875726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 596/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:22.009865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:33:22.010064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:33:22.503960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:22.504765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:22.511731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:22.512271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:22.512702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:22.513389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:22.513833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:22.514249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:22.648201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:22.658711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0f3d316f-2112-48d7-9053-ef82cdf5235c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160873 Aug 05 05:33:22.659444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 591/1187] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:22 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:22.900727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:22.901681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:22.912353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:22.913084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:22.913791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:22.914910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:22.915563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:22.916362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:22.980732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:22.989403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-88311c7c-3f60-4fb8-bee9-211f07cfcfa1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094118 Aug 05 05:33:22.989963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 597/1188] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:23.686565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:23.687505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:23.698028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:23.698504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:23.698926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:23.699804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:23.700266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:23.700679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:23.836653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:23.845222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-66bef8b4-3613-4ae6-8163-8f7b0a733d96 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165332 Aug 05 05:33:23.845783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 592/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:23 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:24.014063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:24.015063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:24.026225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:24.026703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:24.027127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:24.027827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:24.028293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:24.028711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:24.092299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:24.104343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a87527ea-4d00-4656-9b83-452c3aaf5668 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096859 Aug 05 05:33:24.104880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 598/1190] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:24.877839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:24.878887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:24.888567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:24.889050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:24.889475 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:24.890169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:24.890613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:24.891018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:25.034007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:25.042474 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ee5c9ad5-c70e-4c04-b9d4-62085c46aade tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.178094 Aug 05 05:33:25.043032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 593/1191] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:24 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:25.253050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:25.253674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:25.259937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:25.260416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:25.260850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:25.261534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:25.261980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:25.262400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:25.326173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:25.334365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-96a74f3a-7162-4294-84d5-f4522ee3b9a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.204565 Aug 05 05:33:25.334934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 599/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:26.066654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:26.067654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:26.078503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:26.079339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:26.080124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:26.081259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:26.082001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:26.082700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:26.215217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:26.224482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-01d58037-29b7-471d-a98b-2178a9df36e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164410 Aug 05 05:33:26.225060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 594/1193] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:26 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:33:26.359643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:26.360567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:26.371627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:26.372512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:26.373227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:26.374356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:26.375114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:26.375863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:26.444892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:26.456515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5bacd11b-ef57-49cc-92d5-7ca3a9a8744d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103237 Aug 05 05:33:26.457569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 600/1194] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:27.250759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:27.251890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:27.262117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:27.262644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:27.263078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:27.263794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:27.273668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:27.273668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:27.402975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:27.411269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-75ac20a4-5a1e-458b-8ff9-a467be890ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167712 Aug 05 05:33:27.411844 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 595/1195] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:27 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:27.481746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:27.482737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:27.493832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:27.494632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:27.495352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:27.496467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:27.496945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:27.497367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:27.570425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:27.582736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f5400af3-5715-418d-9911-902d0c0789a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.107271 Aug 05 05:33:27.583473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 601/1196] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:28.436514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:28.437482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:28.448558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:28.449344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:28.450046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:28.451158 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:28.451939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:28.452638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:28.592203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:28.600668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f447dd34-8dc4-45f4-96a1-32f32a0afe2a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170722 Aug 05 05:33:28.601410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 596/1197] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:28 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:28.605846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:28.606462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:28.613037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:28.613506 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:28.613905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:28.614580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:28.615019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:28.615439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:28.677780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:28.687057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bc332791-577a-4f0b-af1e-aaf7f5d327a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.085204 Aug 05 05:33:28.687557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 602/1198] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:29.622160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:29.622783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:29.629794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:29.630296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:29.630734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:29.631418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:29.631897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:29.632321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:29.708494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:29.709229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:29.716165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:29.716934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:29.717355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:29.718048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:29.718491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:29.718878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:29.723243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:29.791919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:29.795516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:29.800064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-25de2b18-b9d8-4d5e-b248-da07ceeaec0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096204 Aug 05 05:33:29.800616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 603/1199] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:29.803728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3b97ca51-1b0e-4419-a46f-d9ab1679ec5e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.185671 Aug 05 05:33:29.804319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 597/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:29 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:30.824977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:30.825920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:30.828336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:30.828974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:30.833451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:30.833934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:30.834365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:30.835057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:30.835503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:30.835663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:30.835961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:30.836108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:30.836419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:30.837093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:30.837531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:30.837942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:30.920430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:30.928575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5937f6a5-c733-4465-bb2d-bf71ac1fbed0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.110110 Aug 05 05:33:30.929138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 604/1201] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:30.989989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:31.000545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e400e126-dee4-4686-bc10-e20c2c86e0ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.177601 Aug 05 05:33:31.001438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 598/1202] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:30 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:31.955523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:31.956544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:31.967728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:31.968200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:31.968633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:31.969330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:31.969772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:31.970188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:32.026337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:32.026962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:32.033680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:32.034162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:32.034596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:32.035294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:32.035742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:32.036199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:32.039609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:32.047795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-762b16ba-889e-4c23-9e38-ed674b44abb7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098835 Aug 05 05:33:32.048412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 605/1203] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:32.163845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:32.167332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:32.172550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c6a405f7-3c89-4ef8-bece-9c9f95d408ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.150103 Aug 05 05:33:32.173121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 599/1204] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:32 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:33.072596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:33.073659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:33.082082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:33.082561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:33.082991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:33.083677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:33.084159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:33.084584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:33.146357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:33.154925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-51cd24e7-a3e0-4705-bb02-df1d85831ab0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088834 Aug 05 05:33:33.155419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 606/1205] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:33.197689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:33.198314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:33.206266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:33.206773 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:33.207202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:33.207924 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:33.208369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:33.208788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:33.348545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:33.356792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2bf7f1f6-0ffe-46c0-8f37-53d2c86e65a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165929 Aug 05 05:33:33.357335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 600/1206] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:33 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:34.179656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:34.180746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:34.190037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:34.190600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:34.191032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:34.191714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:34.192193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:34.192641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:34.263138 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:34.271911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-48f64f49-0efc-4c97-b062-71a8c9899b85 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098395 Aug 05 05:33:34.272467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 607/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:34.379619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:34.380258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:34.386729 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:34.387207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:34.387627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:34.388336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:34.388781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:34.389188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:34.519791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:34.528668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c466fa1f-b84f-40f0-b354-b15e2877a6eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.152990 Aug 05 05:33:34.529233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 601/1208] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:34 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:33:35.299502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:35.300300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:35.308722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:35.309324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:35.309902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:35.310766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:35.311326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:35.311943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:35.379083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:35.387262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5aa88145-1a13-46d4-ab28-6d5de6db4d97 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093564 Aug 05 05:33:35.387858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 608/1209] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:35.550589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:35.551143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:35.557994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:35.558480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:35.558908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:35.559593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:35.560067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:35.560485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:35.702731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:35.711056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fabfeff2-8862-4541-8daa-f9fde36cc626 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165169 Aug 05 05:33:35.711624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 602/1210] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:35 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:36.411049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:36.411680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:36.414420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:36.420706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:36.421235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:36.421719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:36.422479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:36.422968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:36.423433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:36.486465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:36.498059 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3a2f077b-7e95-4f98-b6aa-d3a5f9dbba8b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091824 Aug 05 05:33:36.499022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 609/1211] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:36.738454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:36.739395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:36.750080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:36.750848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:36.751559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:36.752748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:36.753479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:36.754224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:36.898175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:36.910618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a1798c35-7d90-440e-9cbe-6b110ed8a765 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.180328 Aug 05 05:33:36.911495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 603/1212] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:36 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:37.522321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:37.522938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:37.532118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:37.532707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:37.533287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:37.534233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:37.534803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:37.535236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:37.599792 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:37.608037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f582a098-a245-4a06-99d5-9b9da6222421 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090473 Aug 05 05:33:37.608596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 610/1213] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:37.940661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:37.941613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:37.944607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:37.953334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:37.954127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:37.954827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:37.955999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:37.956730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:37.957418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:38.093041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:38.101850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c28a14df-56bd-46c1-bec7-ce86cef51a2c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168017 Aug 05 05:33:38.102394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 604/1214] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:37 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:38.631119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:38.631731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:38.638215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:38.638694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:38.639122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:38.639816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:38.640284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:38.640697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:38.706331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:38.718935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5d3d0fe3-25f8-41bc-96d4-ab6460a04653 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091930 Aug 05 05:33:38.719522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 611/1215] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:39.124194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:39.124887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:39.132957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:39.133462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:39.133913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:39.134626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:39.135095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:39.135530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:39.279370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:39.290962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-000d03d4-50da-4e43-8788-aa41e24e0a41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170674 Aug 05 05:33:39.291793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 605/1216] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:39 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:39.744598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:39.745605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:39.756754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:39.757588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:39.758307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:39.759444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:39.760233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:39.760928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:39.828379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:39.837020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bd107b45-0aea-4f28-9a84-cd100b466c60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099032 Aug 05 05:33:39.837594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 612/1217] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:40.323322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:40.324422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:40.343813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:40.344649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:40.345473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:40.346275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:40.346725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:40.347163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:40.493088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:40.505519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9ee4eb34-0147-48cf-bb88-3783642d2a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.188281 Aug 05 05:33:40.506223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 606/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:40 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:40.862240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:40.863213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:40.874241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:40.875044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:40.875730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:40.877040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:40.877489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:40.877905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:40.940566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:40.949241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-41b14660-aad3-491d-84d7-0c3d90a1f2b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093539 Aug 05 05:33:40.949810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 613/1219] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:41.534961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:41.535665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:41.543653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:41.544268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:41.544776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:41.545584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:41.546110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:41.546603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:41.684936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:41.693453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-377bede1-e562-4901-b1ac-8d442dd39120 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164525 Aug 05 05:33:41.694005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 607/1220] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:41 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:41.974535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:41.975602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:41.986655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:41.987158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:41.987583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:41.988291 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:41.988733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:41.989146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:42.063751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:42.072015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-621ed106-c452-4915-9975-a828a0231b55 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.104012 Aug 05 05:33:42.072587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 614/1221] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:42.718834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:42.719934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:42.730739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:42.731507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:42.732411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:42.733538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:42.734282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:42.734975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:42.872163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:42.884686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2587734c-c79f-49c3-ade1-b9fd6b07977a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172194 Aug 05 05:33:42.885518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 608/1222] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:42 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:43.097729 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:43.098732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:43.109599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:43.110385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:43.111098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:43.112261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:43.113002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:43.113668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:43.181370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:43.190097 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-44ff2862-2202-44aa-9294-843c539863a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099057 Aug 05 05:33:43.190662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 615/1223] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:43.911836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:43.913067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:43.924330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:43.925174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:43.925891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:43.927027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:43.927824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:43.928521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:44.065909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:44.074069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eabd2b4f-d746-414d-b7e3-1c020278afcc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168894 Aug 05 05:33:44.074624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 609/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:43 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:44.214880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:44.215710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:44.226549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:44.227350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:44.228142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:44.229337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:44.230095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:44.230786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:44.296103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:44.304655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-036879ff-7783-4f74-bc7b-41e5cbccb76a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096432 Aug 05 05:33:44.305245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 616/1225] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:45.098621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:45.099628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:45.110583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:45.111486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:45.111947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:45.112630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:45.113068 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:45.113481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:45.247315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:45.256964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c340c0d3-6c38-42d9-8f52-75b109e5c8a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164970 Aug 05 05:33:45.257565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 610/1226] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:45 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:45.394907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:45.397491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:45.409943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:45.410447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:45.410912 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:45.411712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:45.412321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:45.412791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:45.477916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:45.485992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5b1f3545-253a-43f2-b476-56ca990f6dc2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097590 Aug 05 05:33:45.486552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 617/1227] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:46.282825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:46.283622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:46.290515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:46.291006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:46.291443 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:46.292187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:46.292677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:46.293100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:46.424991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:46.433363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e04ddeb2-fa0e-4848-b84d-489150207336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157300 Aug 05 05:33:46.433942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 611/1228] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:46 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:46.511018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:46.512081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:46.521028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:46.521870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:46.522303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:46.522988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:46.523437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:46.523886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:46.594057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:46.602491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-978076de-10a7-4cdf-b742-9776c15fb98e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098059 Aug 05 05:33:46.603069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 618/1229] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:47.459015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:47.460101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:47.470793 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:47.471586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:47.472357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:47.473472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:47.474216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:47.474909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:47.615998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:47.623498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:47.624061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3c898d7b-a95c-413e-ac81-71a59a0101b3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171729 Aug 05 05:33:47.624188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:47.624635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 612/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:47 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:47.630963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:47.631440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:47.631899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:47.632593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:47.633034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:47.633450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:47.705232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:47.710073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:47.717389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-30e39816-b413-4cc8-afd1-2b44ac90babe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097481 Aug 05 05:33:47.718142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 619/1231] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:48.651672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:48.652846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:48.663657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:48.664511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:48.665232 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:48.666372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:48.667117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:48.667837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:48.739612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:48.740276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:48.747104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:48.747581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:48.748124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:48.748810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:48.749251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:48.749674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:48.819664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:48.827881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:48.828337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dd0c086c-881f-4a95-becf-4bf603314020 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093153 Aug 05 05:33:48.828915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 620/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:48.837099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-16781ab7-03f2-4371-968e-2025417d25fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.192428 Aug 05 05:33:48.837691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 613/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:48 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:49.853006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:49.854089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:49.862229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:49.863233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:49.864950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:49.865745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:49.866455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:49.867585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:49.868377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:49.869067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:49.874719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:49.876340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:49.877136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:49.877854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:49.878295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:49.878707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:49.959737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:49.967803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eacfde29-a074-4fc7-ade0-e72fb9a6dc07 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.121450 Aug 05 05:33:49.968374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 621/1234] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:50.028265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:50.036246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-813e3708-21bb-45bc-a950-9bcec72c53bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.180708 Aug 05 05:33:50.036841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 614/1235] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:49 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:50.992883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:50.993857 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:51.004795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:51.005603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:51.006317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:51.007480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:51.008268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:51.008971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:51.057014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:51.057627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:51.064246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:51.064751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:51.065177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:51.065861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:51.066305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:51.066700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:51.074229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:51.083573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d33f0dfd-6ead-498d-9df4-8cb1aa7456b8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097267 Aug 05 05:33:51.084216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 622/1236] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:51.210836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:51.219127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2873c93b-a9fd-4472-a53c-f8d092871b94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165970 Aug 05 05:33:51.219695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 615/1237] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:51 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:33:52.110893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:52.112031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:52.122593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:52.123370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:52.124144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:52.125277 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:52.126013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:52.126892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:52.200482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:52.213538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-584e7dbf-0c39-4f48-8615-acffd618af6b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.109554 Aug 05 05:33:52.214352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 623/1238] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:52.240255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:52.240937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:52.247606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:52.248117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:52.248555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:52.249239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:52.249684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:52.250101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:52.268952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:33:52.389776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:52.399649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-195543ef-f1ea-4053-920b-061d4bef3ac0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163188 Aug 05 05:33:52.400230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 616/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:52 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:53.238450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:53.239013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:53.246163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:53.246645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:53.247077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:53.247795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:53.248235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:53.248678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:53.314235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:53.322390 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b94d483b-e8b0-4fc6-9c97-e8c48c929a0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089651 Aug 05 05:33:53.322954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 624/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:53.424765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:53.425404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:53.432964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:53.433495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:53.433967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:53.434721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:53.435229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:53.435689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:53.571005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:53.579353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-da322c7f-2da1-47bb-a010-ee4f5fe68fe6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160843 Aug 05 05:33:53.579930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 617/1241] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:53 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:54.347189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:54.347838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:54.354967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:54.355474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:54.355967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:54.356701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:54.357173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:54.357579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:54.424243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:54.432472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7feaa761-9760-4797-bd7d-099283668b0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092308 Aug 05 05:33:54.433042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 625/1242] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:54.604435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:54.605037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:54.615124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:54.615833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:54.616402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:54.617419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:54.618074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:54.618665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:54.765635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:54.774506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-37e7d908-a854-4912-b855-b6c6995b9e3b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.176363 Aug 05 05:33:54.775056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 618/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:55.455826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:55.456621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:55.464741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:55.465291 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:55.465810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:55.466633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:55.467142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:55.467646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:55.534621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:55.543071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c86de484-eb0f-4cff-a4eb-bf1b98d8ac75 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093493 Aug 05 05:33:55.543657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 626/1244] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:55.800425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:55.801266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:55.812186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:55.812985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:55.813700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:55.814738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:55.815175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:55.815605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:55.956449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:55.965187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-db401e90-06d4-4598-abb0-1dfea2613d72 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171600 Aug 05 05:33:55.965744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 619/1245] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:55 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:56.564515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:56.565232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:56.572371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:56.572845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:56.573274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:56.573951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:56.574392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:56.574806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:56.640929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:56.649413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e4abdf15-a0a2-40e1-8500-d8344540e2c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088961 Aug 05 05:33:56.650129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 627/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:56.990693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:56.991693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:57.002524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:57.003315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:57.004545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:57.005237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:57.005943 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:57.006643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:57.142229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:57.151085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a6e6c6ce-7986-4e90-bb26-6ad84862b41b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167015 Aug 05 05:33:57.151656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 620/1247] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:57.674701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:57.675363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:57.682698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:57.683221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:57.683674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:57.684445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:57.684918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:57.685372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:57.755054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:57.764250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-00c42959-c393-4cf3-993d-aac081d9637f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095744 Aug 05 05:33:57.764828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 628/1248] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:58.175505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:58.176483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:58.187269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:58.188137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:58.188841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:58.189742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:58.190188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:58.190596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:58.327411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:58.339465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4185c171-d47f-4882-a548-bd255615711e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170228 Aug 05 05:33:58.340469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 621/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:58 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:58.789759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:58.790678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:58.801631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:58.802419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:58.803135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:58.804308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:58.805047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:58.805735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:58.871002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:58.879224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ac695a81-6e20-4ec9-8f83-41e1d79b6210 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096281 Aug 05 05:33:58.879791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 629/1250] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:59.365951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:59.366913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:59.377661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:59.378452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:59.379157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:59.380324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:59.381009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:59.381752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:59.513691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:59.526296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1d4767a1-9380-4d42-a038-07494c7cf3eb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166749 Aug 05 05:33:59.527106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 622/1251] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:59 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:33:59.904538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:33:59.905582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:33:59.916594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:59.917412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:59.918133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:59.919283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:33:59.920091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:33:59.920810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:33:59.988919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:33:59.998703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1caaccd4-9cca-4440-8f28-5d60991b43f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.100768 Aug 05 05:33:59.999285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 630/1252] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:33:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:00.552116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:00.553183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:00.564396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:00.565052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:00.565490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:00.566185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:00.566638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:00.567069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:00.695411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:00.703537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-28b4c4b0-f793-4edd-b635-130c2a9a4ea9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158019 Aug 05 05:34:00.704137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 623/1253] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:01.019875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:01.020530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:01.027903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:01.028396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:01.028829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:01.029522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:01.029974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:01.030396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:01.092385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:01.100868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4cef4db5-86b6-4437-b88f-7c86e3b8d194 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.085026 Aug 05 05:34:01.101475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 631/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:01.729446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:01.730419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:01.739897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:01.740377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:01.740803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:01.741485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:01.741926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:01.742340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:01.882760 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:01.891077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7b885148-c498-4033-a5c0-a9f9e64b9e8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168089 Aug 05 05:34:01.891641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 624/1255] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:01 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:02.125901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:02.126919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:02.137780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:02.138567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:02.139280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:02.140466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:02.141208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:02.141895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:02.208106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:02.220678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-375d6338-8241-4933-b9c0-01c3f4909199 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101153 Aug 05 05:34:02.221232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 632/1256] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:02.917034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:02.918044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:02.927180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:02.927669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:02.928135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:02.928821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:02.929270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:02.929685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:03.063957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:03.075897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d1933392-d190-4fd3-a347-65d4e136e7d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165217 Aug 05 05:34:03.076666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 625/1257] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:03.251117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:03.252172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:03.259042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:03.259520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:03.259994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:03.260707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:03.261148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:03.261562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:03.325813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:03.334307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-94e2985b-ff76-4e4d-8586-065dce1374a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089717 Aug 05 05:34:03.334916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 633/1258] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:04.100697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:04.101264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:04.109337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:04.109999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:04.110652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:04.111695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:04.112519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:04.113133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:04.252650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:04.260963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9ae8264c-ca7b-4d63-8e74-2f644845acd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164192 Aug 05 05:34:04.261502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 626/1259] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:04 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:04.360194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:04.361186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:04.368350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:04.368832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:04.369263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:04.369947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:04.370391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:04.370806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:04.438490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:04.446804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cc065b97-5b89-4faf-9a01-87fafcd3eedd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093091 Aug 05 05:34:04.447353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 634/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:05.286925 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:05.287903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:05.298600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:05.299312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:05.299747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:05.300461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:05.300909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:05.301322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:05.445203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:05.453586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7885b5ef-df52-4fd7-b316-366fefedf7cf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.173374 Aug 05 05:34:05.454157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 627/1261] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:05 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:05.468442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:05.469066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:05.476042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:05.476952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:05.477392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:05.478121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:05.478603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:05.479022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:05.554439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:05.562509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2a01c46d-1f35-4c96-af27-2acd67caba44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098677 Aug 05 05:34:05.563069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 635/1262] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:06.481095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:06.482094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:06.493107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:06.493952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:06.494664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:06.495810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:06.496583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:06.497277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:06.584026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:06.584637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:06.587168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:06.592930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:06.593426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:06.593854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:06.594543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:06.594982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:06.595391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:06.613583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:06.634150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:06.642269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-324630ef-7306-4c0b-be25-e7c506c81e7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167895 Aug 05 05:34:06.642893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 628/1263] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:06 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:06.662008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:06.674379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4ba3a56d-fdc5-4b9e-9ae4-5586dfe535b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094019 Aug 05 05:34:06.674918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 636/1264] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:07.667983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:07.668962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:07.677207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:07.677681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:07.678105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:07.678781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:07.679219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:07.679635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:07.702189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:07.702788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:07.709696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:07.710157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:07.710586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:07.711309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:07.711759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:07.712216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:07.778379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:07.786918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-27eb87a0-a371-4743-b5f3-309c27064fd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088726 Aug 05 05:34:07.787495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 637/1265] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:07.838384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:07.846864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-07aafdd5-6872-4ec3-8e8a-b33d6ab7da7d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.185703 Aug 05 05:34:07.847431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 629/1266] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:07 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:08.812429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:08.813477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:08.820769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:08.821309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:08.821747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:08.822481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:08.822961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:08.823406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:08.868488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:08.869111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:08.871461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:08.877324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:08.877808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:08.878244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:08.878936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:08.879384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:08.879823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:08.895480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:08.904958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-20ee3b5e-3cc9-491d-b47d-b21bcaf1e4cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099491 Aug 05 05:34:08.905659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 638/1267] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:09.019168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:09.027955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-31db2c40-ba10-484e-8c3f-5e6427299b47 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163438 Aug 05 05:34:09.028527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 630/1268] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:08 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:09.931852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:09.932794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:09.943663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:09.944510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:09.945220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:09.946341 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:09.947076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:09.947832 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:10.015910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:10.028286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8ac33c7f-4e21-4851-a02e-69f2c746700c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.102678 Aug 05 05:34:10.029029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 639/1269] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:10.049239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:10.049849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:10.056659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:10.057139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:10.057572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:10.058255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:10.058700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:10.059119 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:10.187470 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:10.196408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-566b569f-d193-4f8a-8527-4ac4d319f140 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.150913 Aug 05 05:34:10.196949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 631/1270] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:10 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:11.054646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:11.055581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:11.065679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:11.066157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:11.066586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:11.067274 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:11.067722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:11.068166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:11.133326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:11.141426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2b896a2f-6ed7-4cd4-88c4-d43076b4a719 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093414 Aug 05 05:34:11.141993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 640/1271] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:11.228839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:11.229658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:11.239147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:11.239625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:11.240084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:11.240765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:11.241209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:11.241639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:11.371648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:11.380155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8f69ec3e-e9e3-4070-9734-d65243a5ab6c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157978 Aug 05 05:34:11.380719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 632/1272] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:11 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:12.166953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:12.167961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:12.177267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:12.177749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:12.178179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:12.178873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:12.179321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:12.179740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:12.249111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:12.257775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-97c07855-25b6-4d59-8289-bc69591d5d3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097319 Aug 05 05:34:12.258287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 641/1273] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:12.405998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:12.406921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:12.414448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:12.414940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:12.415368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:12.416104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:12.416551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:12.416972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:12.420978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:12.557608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:12.566206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2990c308-7e03-4f23-bc5e-ea1d1f27697d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166844 Aug 05 05:34:12.566742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 633/1274] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:12 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:13.282883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:13.283712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:13.290803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:13.291286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:13.291720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:13.292524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:13.295844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:13.295844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:13.359590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:13.368452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2430406a-8f9c-4b02-879b-19d1281a5ae1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092303 Aug 05 05:34:13.369025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 642/1275] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:13.587163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:13.587733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:13.594666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:13.595152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:13.595591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:13.596311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:13.596765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:13.597186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:13.741955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:13.753790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-45ea8114-a46b-4f16-955e-f5ff52e7c154 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170703 Aug 05 05:34:13.754329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 634/1276] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:13 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:14.395330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:14.396297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:14.406964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:14.407445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:14.408243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:14.408934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:14.409430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:14.410203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:14.477354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:14.485632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fe079aeb-b090-4244-a4ce-e2736c312f60 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097578 Aug 05 05:34:14.486168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 643/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:14.780227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:14.781205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:14.788903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:14.789404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:14.789833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:14.790520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:14.790972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:14.791389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:14.930945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:14.941202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-40f512c7-a69e-46ab-8d94-7e66d3473374 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167174 Aug 05 05:34:14.941902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 635/1278] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:14 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:15.511531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:15.512612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:15.524282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:15.525069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:15.525780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:15.526917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:15.527645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:15.528385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:15.592691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:15.600885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bd5e0afd-1d2f-4345-a61d-35697f602327 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096164 Aug 05 05:34:15.601450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 644/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:15.967178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:15.968231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:15.982296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:15.983111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:15.983837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:15.985022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:15.985772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:15.986541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:16.121383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:16.129494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-21a8fb56-8b83-49b1-b17b-0e430e712207 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168832 Aug 05 05:34:16.130063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 636/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:15 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:16.625563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:16.626566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:16.638238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:16.639580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:16.640427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:16.641552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:16.642298 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:16.642993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:16.704916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:16.713382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-763b2faf-b383-4376-adf2-3897ab137ff2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094308 Aug 05 05:34:16.713949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 645/1281] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:17.154541 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:17.155576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:17.166423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:17.167200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:17.168001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:17.169147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:17.169891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:17.170587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:17.306761 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:17.318385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-88be8e97-a3b4-44f0-bf20-a9a01a34c35b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170217 Aug 05 05:34:17.319199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 637/1282] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:17 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:17.738783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:17.739819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:17.750811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:17.751610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:17.752380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:17.753599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:17.754042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:17.754464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:17.831096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:17.839368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-46da7534-7339-4d85-9aec-9a9157ee6489 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.107450 Aug 05 05:34:17.839972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 646/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:18.344505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:18.345507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:18.355125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:18.355614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:18.356081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:18.356776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:18.357256 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:18.357708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:18.485277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:18.493512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cf3ed8d5-fe10-4116-8ff6-a7d8d56a5e98 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.155831 Aug 05 05:34:18.494113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 638/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:18 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:18.861023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:18.861772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:18.868597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:18.869073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:18.869497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:18.870173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:18.870611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:18.871027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:18.940976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:18.949406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c31e4683-187e-4fe1-91d1-447e23131634 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092598 Aug 05 05:34:18.949973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 647/1285] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:19.519044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:19.519819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:19.528522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:19.529118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:19.529649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:19.530494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:19.531048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:19.531566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:19.670064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:19.678625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dae3633d-eeec-4b98-abef-a1c84d53caf5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166247 Aug 05 05:34:19.679180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 639/1286] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:19 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:19.974402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:19.975160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:19.984045 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:19.984678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:19.985245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:19.986146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:19.986744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:19.987288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:20.057236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:20.065603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3d3c3cab-0934-4e46-ba0a-a5c09ce999fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097543 Aug 05 05:34:20.066253 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 648/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:20.711370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:20.712347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:20.722968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:20.723450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:20.723912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:20.724600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:20.725047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:20.725464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:20.860536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:20.870017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d74f765d-a20e-485d-b5ec-736b03c66fcf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165188 Aug 05 05:34:20.870557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 640/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:20 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:21.088537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:21.089115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:21.098931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:21.099433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:21.099896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:21.100609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:21.101048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:21.101460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:21.170235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:21.178528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9b5ac284-58ec-4c0e-8a31-69f01ccd9db4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094308 Aug 05 05:34:21.179090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 649/1289] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:21.904134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:21.905065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:21.916174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:21.916971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:21.917688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:21.918811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:21.919556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:21.920301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:22.051954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:22.060079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8c0ea48f-ebe6-4cf1-b982-bb81e2533f7e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162534 Aug 05 05:34:22.060648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 641/1290] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:21 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:22.203592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:22.204663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:22.215583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:22.216438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:22.217163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:22.218351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:22.219099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:22.219919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:22.284018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:22.292475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-45d280ef-5f68-48b2-a107-8dd7dab44d0c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095479 Aug 05 05:34:22.293043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 650/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:23.084309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:23.085012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:23.091797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:23.092327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:23.092759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:23.093443 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:23.093889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:23.094320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:23.243104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:23.256108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1c7765ed-a896-47dc-ac4c-abc78cf35d4c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.176583 Aug 05 05:34:23.256954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 642/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:23 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:23.317205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:23.318213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:23.329033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:23.329834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:23.330539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:23.331732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:23.332202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:23.332601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:23.393849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:23.402603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-965c54d2-4041-4704-bcda-dad1c0b708dd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091888 Aug 05 05:34:23.403173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 651/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:24.282220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:24.283055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:24.294002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:24.294806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:24.295526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:24.296726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:24.297475 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:24.298183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:24.423345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:24.424360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:24.431616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:24.432125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:24.432791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:24.433320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:24.433474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:24.433916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:24.434467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:24.442449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-632a0458-ecfb-4180-af94-72425bdc1a60 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166909 Aug 05 05:34:24.443046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 643/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:24 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:24.506520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:24.518181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a14e2dfc-bdfb-47ac-9d6f-cb73e0f8d64f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098552 Aug 05 05:34:24.518901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 652/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:34:25.464394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:25.464961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:25.471803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:25.472371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:25.472808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:25.473494 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:25.473977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:25.474344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:25.540284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:25.540919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:25.549604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:25.550140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:25.550606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:25.551348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:25.551811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:25.552226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:25.556444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:25.621946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:25.630176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-231ff745-d29f-44c2-85c0-54b5151fc75d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094110 Aug 05 05:34:25.630895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 653/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:25.638503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:25.648013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0960f3d3-d450-4598-83f9-1f6781f1ab8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.187401 Aug 05 05:34:25.648625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 644/1297] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:25 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:26.655152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:26.656133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:26.667290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:26.668131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:26.668920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:26.669970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:26.670712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:26.671410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:26.676745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:26.677369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:26.684074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:26.684583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:26.685014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:26.685729 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:26.686169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:26.686582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:26.739467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:26.747591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3a1d79b9-05c5-4ca6-a0fa-e8ed6c6c89b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098927 Aug 05 05:34:26.748233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 654/1298] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:26.835140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:26.843135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ef7233de-edc3-4b61-924e-54bd144d7361 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172038 Aug 05 05:34:26.843699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 645/1299] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:26 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:27.772471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:27.773428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:27.784353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:27.785019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:27.785449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:27.786124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:27.786565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:27.786980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:27.849558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:27.857772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-03059bb7-c0e5-4b8b-87d0-fa02338b630c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092307 Aug 05 05:34:27.858319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 655/1300] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:27.864485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:27.866030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:27.871829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:27.872619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:27.872760 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:27.874048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:27.874048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:27.874426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:28.011733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:28.021571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3f085bf7-7f1a-4d75-b63e-07c77b608ddf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161066 Aug 05 05:34:28.022167 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 646/1301] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:27 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:28.882237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:28.882829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:28.889762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:28.890251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:28.890878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:28.891567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:28.892032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:28.892456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:28.960376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:28.972028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e4a50981-911b-4509-929d-6b29af773d96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093483 Aug 05 05:34:28.972973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 656/1302] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:29.044339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:29.044950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:29.051590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:29.052110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:29.052545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:29.053227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:29.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:29.054096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:29.188806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:29.197028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-525c943c-c550-459a-b0b2-7f86c0e82df5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157110 Aug 05 05:34:29.197570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 647/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:29 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:30.004142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:30.004142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:30.015599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:30.016471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:30.017148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:30.018369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:30.019144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:30.019563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:30.094018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:30.102348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cc4a2241-4fd7-41a8-927f-e24deb26556d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.106014 Aug 05 05:34:30.102922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 657/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:30.222659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:30.223660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:30.234445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:30.235268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:30.236015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:30.237153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:30.237920 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:30.238366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:30.371513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:30.379872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a789fb52-6af8-4940-be50-fa3bc60440c1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163850 Aug 05 05:34:30.380446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 648/1305] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:30 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:31.122687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:31.123252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:31.130162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:31.130643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:31.131072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:31.131790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:31.132240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:31.132664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:31.194946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:31.203476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e477b2e2-aace-4883-9b3d-99a711408af8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084743 Aug 05 05:34:31.204093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 658/1306] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:31.405805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:31.406819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:31.417699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:31.418496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:31.419213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:31.420401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:31.421143 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:31.421889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:31.555447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:31.558972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:31.564499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eb649071-260d-40ab-aab4-0c73754869fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165310 Aug 05 05:34:31.565068 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 649/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:31 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:32.228908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:32.229842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:32.240255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:32.240736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:32.241170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:32.241888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:32.242337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:32.242761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:32.305413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:32.313601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-12334363-ad71-4ad5-9f04-ca6639889bbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091481 Aug 05 05:34:32.314169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 659/1308] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:32.590024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:32.590929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:32.600777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:32.601265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:32.601700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:32.602388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:32.602833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:32.603250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:32.760676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:32.773178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f46ec317-0687-418a-b455-058277edbdbd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.189691 Aug 05 05:34:32.773951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 650/1309] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:32 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:33.338972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:33.339888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:33.349863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:33.350370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:33.350780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:33.351471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:33.351958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:33.352382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:33.416721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:33.425113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c82421c9-e924-451e-b19d-cfc869c6b0a2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092941 Aug 05 05:34:33.425691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 660/1310] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:33.798806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:33.799861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:33.807797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:33.808361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:33.808839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:33.809600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:33.810095 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:33.810559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:33.938830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:33.946888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a3411a5a-327e-4942-b5dc-e05261001fc3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154693 Aug 05 05:34:33.947459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 651/1311] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:33 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:34.450255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:34.451206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:34.460524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:34.461027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:34.461454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:34.462237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:34.462685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:34.463093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:34.526817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:34.539100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f2c6dcc6-52be-4f6b-8ad3-2c9d7f087e18 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095259 Aug 05 05:34:34.539974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 661/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:34.971402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:34.972486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:34.979667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:34.980188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:34.980617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:34.981307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:34.981751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:34.982168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:35.119667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:35.131709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3464c4b5-49b1-45a5-8916-cb1dc19a4176 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166722 Aug 05 05:34:35.132495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 652/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:34 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:35.564491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:35.565499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:35.572915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:35.573398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:35.573829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:35.574518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:35.574968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:35.575386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:35.643864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:35.652886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cf456825-20ec-4683-85a5-d68b192a1265 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094991 Aug 05 05:34:35.653459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 662/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:36.162244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:36.163215 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:36.174422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:36.175220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:36.176152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:36.176840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:36.177308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:36.177724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:36.310853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:36.319241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-081778ce-552b-4788-91e8-9e9b691fbbfc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163544 Aug 05 05:34:36.319806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 653/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:36 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:36.678580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:36.679559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:36.683419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:36.692427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:36.693203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:36.693914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:36.695037 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:36.695808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:36.696498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:36.779528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:36.794703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-72dd55b1-d16b-46a0-8b6f-837107513531 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.122518 Aug 05 05:34:36.795547 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 663/1316] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:37.344965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:37.346012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:37.356185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:37.356980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:37.357685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:37.358812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:37.359547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:37.360282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:37.494572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:37.507053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-71ea96ed-c2ed-49d2-8e36-3a4954e0d87b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168679 Aug 05 05:34:37.507759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 654/1317] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:37 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:37.826220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:37.827150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:37.838113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:37.838911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:37.839630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:37.840823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:37.841565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:37.842273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:37.904822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:37.912922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-abe656ad-f528-4082-a11f-0df2591f6b69 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093477 Aug 05 05:34:37.913497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 664/1318] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:38.532405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:38.533423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:38.541058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:38.541551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:38.541983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:38.542671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:38.543120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:38.543543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:38.933808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:38.934456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:38.941619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:38.942121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:38.942532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:38.943250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:38.943668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:38.944124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:38.948965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:38.959279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6723aaf7-1fcd-45c1-b3e0-d6a388957b20 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.433498 Aug 05 05:34:38.959876 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 655/1319] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:38 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:39.011235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:39.019867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1bbd8aa9-7fc8-49a5-b12f-781361556922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089949 Aug 05 05:34:39.020775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 665/1320] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:39.980438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:39.981051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:39.984637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:39.989026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:39.989503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:39.989934 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:39.990623 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:39.991067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:39.991486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:40.042620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:40.043247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:40.050265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:40.050743 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:40.051173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:40.052038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:40.052535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:40.052957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:40.153189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:40.161585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-71673957-aeb9-44c2-9f30-9bf3bab4b649 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.184923 Aug 05 05:34:40.165201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 656/1321] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:39 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:40.180548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:40.190856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d97d0a95-4ff5-4e8c-bd95-10a173ca82f1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.152519 Aug 05 05:34:40.191507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 666/1322] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:34:41.183114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:41.183812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:41.192624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:41.193207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:41.193736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:41.194510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:41.195024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:41.195511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:41.211890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:41.212566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:41.218863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:41.219342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:41.219796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:41.220487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:41.220931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:41.221350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:41.298389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:41.307931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fc8eaee6-b13d-4c7e-81fe-7178c1eaa167 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099588 Aug 05 05:34:41.320028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 667/1323] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:34:41.358166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:41.366582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2210264c-6cb6-4416-b52f-c50283697660 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.187420 Aug 05 05:34:41.367174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 657/1324] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:41 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:42.333710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:42.334685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:42.345394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:42.346181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:42.346890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:42.348113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:42.348584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:42.348981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:42.388263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:42.388969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:42.397184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:42.397664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:42.398094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:42.398785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:42.399234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:42.399658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:42.413979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:42.422050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-883eb4a9-c7b1-4e77-96ff-ed2c9e8d08a0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095043 Aug 05 05:34:42.422622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 668/1325] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:42.535606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:42.545096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ffdf9ad9-f010-4e2a-8f5f-366035efc7b7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160911 Aug 05 05:34:42.545709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 658/1326] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:42 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:34:43.446911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:43.448074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:43.458570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:43.459048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:43.459455 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:43.460203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:43.460646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:43.461068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:43.536202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:43.539628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:43.545032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e5f774cc-ce6a-47a6-8049-5f7f86b78d0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.104929 Aug 05 05:34:43.545607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 669/1327] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:43.565948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:43.566561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:43.573535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:43.574020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:43.574450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:43.575136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:43.575587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:43.576038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:43.711263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:43.722490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6e9a0215-b4a5-4231-aea7-d4aa7631b074 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160427 Aug 05 05:34:43.723102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 659/1328] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:43 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:44.572504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:44.573562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:44.585281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:44.586093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:44.586811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:44.588110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:44.588865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:44.589567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:44.658320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:44.667710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-918bec21-1bd5-4c03-9a50-ae0e79402fdb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101959 Aug 05 05:34:44.668324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 670/1329] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:44.746767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:44.747638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:44.757212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:44.757700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:44.758130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:44.758816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:44.759260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:44.759679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:44.903506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:44.912453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-962356d9-866b-4a2f-8674-aecc102f7ffa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172398 Aug 05 05:34:44.913025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 660/1330] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:44 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:45.692862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:45.693829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:45.704977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:45.705771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:45.706488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:45.707628 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:45.708426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:45.709280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:45.770297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:45.779361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3bf24cd9-af8a-425a-b987-dbf0db0a54fa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093131 Aug 05 05:34:45.779957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 671/1331] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:45.942564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:45.943749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:45.950540 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:45.951019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:45.951449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:45.952175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:45.952662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:45.953077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:46.083142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:46.093646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-78f96e4e-c02a-4de6-8791-e1ace325bcd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157264 Aug 05 05:34:46.094331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 661/1332] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:45 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:46.804470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:46.805629 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:46.816706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:46.817496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:46.818184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:46.819349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:46.820260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:46.820691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:46.887272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:46.895954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-519697c2-6561-4d1f-9166-09484537e486 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097635 Aug 05 05:34:46.896533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 672/1333] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:47.119752 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:47.120746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:47.131585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:47.132440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:47.133152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:47.134290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:47.135045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:47.135745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:47.273209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:47.281789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-255ca389-0cfd-4bdf-bfd6-59902c665d94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168728 Aug 05 05:34:47.282364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 662/1334] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:47 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:47.926701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:47.927660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:47.935593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:47.936121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:47.936572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:47.937284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:47.937747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:47.938182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:48.001899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:48.012192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-49aec518-4709-4367-90e7-5ea880f1858a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091973 Aug 05 05:34:48.012757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 673/1335] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:48.306846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:48.307811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:48.318674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:48.319482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:48.320334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:48.321039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:48.321486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:48.321876 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:48.464851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:48.473336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d5543ce5-761a-40fd-9ef4-76a72895f0fb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.173141 Aug 05 05:34:48.473893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 663/1336] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:48 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:49.038434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:49.039146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:49.046169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:49.046644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:49.047072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:49.047757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:49.048239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:49.048654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:49.117705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:49.126076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e01d6933-abd1-4b82-abea-d88a2e9b588c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092602 Aug 05 05:34:49.126650 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 674/1337] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:49.499465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:49.500489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:49.511378 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:49.512202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:49.512966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:49.514096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:49.514837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:49.515579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:49.652198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:49.664237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4698ed04-a941-4c6c-8d56-d5689e41c196 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171129 Aug 05 05:34:49.664980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 664/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:49 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:50.154545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:50.155516 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:50.166392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:50.167185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:50.167950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:50.169100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:50.169831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:50.170522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:50.249671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:50.258206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f81df33d-0136-41e6-99d5-07514baaabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.110454 Aug 05 05:34:50.258719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 675/1339] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:50.689539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:50.690523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:50.699693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:50.700213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:50.700651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:50.701328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:50.701777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:50.702209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:50.837533 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:50.845720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c9fb8b98-0097-4f26-9755-9945faca6ebc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162798 Aug 05 05:34:50.846294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 665/1340] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:50 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:51.284182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:51.285043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:51.293983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:51.294467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:51.294898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:51.295587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:51.296060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:51.296486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:51.358194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:51.366351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d81aef06-66de-44a4-91f7-1dc49d44f050 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089134 Aug 05 05:34:51.366917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 676/1341] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:52.051693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:52.052351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:52.058413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:52.058893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:52.059324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:52.060033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:52.060515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:52.061049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:52.081648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:34:52.195077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:52.203383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3e52e81e-e2d1-47e5-a20b-960c48b21c69 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.331314 Aug 05 05:34:52.203979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 666/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:51 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:52.393775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:52.394679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:52.403530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:52.404050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:52.404478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:52.405170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:52.405669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:52.406088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:52.484602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:52.492888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5c4891c3-db28-47c4-a889-4e76c06359ae tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105719 Aug 05 05:34:52.493613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 677/1343] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:53.228643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:53.230435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:53.241646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:53.242428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:53.243136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:53.244051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:53.244490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:53.244902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:53.382965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:53.391383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e1d45937-7069-4850-99bd-249ae0b9e87d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169593 Aug 05 05:34:53.391997 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 667/1344] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:53 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:53.519028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:53.519955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:53.531383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:53.532228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:53.532938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:53.534078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:53.534815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:53.535514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:53.604741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:53.613089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-55080f06-011d-4e95-a733-499830fc4f8c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.100840 Aug 05 05:34:53.613651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 678/1345] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:54.420040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:54.420618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:54.427649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:54.428172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:54.428603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:54.429292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:54.429739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:54.430139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:54.568290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:54.581391 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-27713d00-5492-4280-a9fc-f0c4953f0c50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165064 Aug 05 05:34:54.582173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 668/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:54.634244 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:54.634810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:54.643129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:54.643615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:54.644078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:54.644769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:54.645583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:54.646009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:54.716779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:54.725070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8642404f-dff4-4ae4-896f-48115767dd52 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094888 Aug 05 05:34:54.725654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 679/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:55.605633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:55.606244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:55.613953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:55.614456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:55.614882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:55.615596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:55.616205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:55.616622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:55.746409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:55.747039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:55.753800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:55.754285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:55.754720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:55.755558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:55.755959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:55.756387 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:55.758123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:55.766637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8363f63b-12b8-4dc8-88f7-2a30257ef944 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165893 Aug 05 05:34:55.767311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 669/1348] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:55 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:55.818789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:55.827526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-af74a236-4d15-4257-8994-7c6159b20522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.085326 Aug 05 05:34:55.828151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 680/1349] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:56.792353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:56.793240 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:56.804024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:56.804875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:56.805614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:56.806484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:56.806927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:56.807343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:56.848560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:56.849228 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:56.856434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:56.856985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:56.857485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:56.858180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:56.858622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:56.859036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:56.928754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:56.937205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d439650f-da1b-48e1-9986-a29db47fdd90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092529 Aug 05 05:34:56.937786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 681/1350] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:56.958800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:56.967408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cde7ac4c-7f4b-4401-a9ab-fab68d19fb88 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.181712 Aug 05 05:34:56.967991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 670/1351] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:57.962642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:57.963642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:57.974925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:57.975726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:57.976494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:57.977767 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:57.978213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:57.978638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:57.989332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:57.989945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:57.996866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:57.997552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:57.997976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:57.998706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:57.999160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:57.999579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:58.054359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:58.062785 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-18dbdc2a-a0dd-48bb-98ff-0fc6b4b8de20 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.106874 Aug 05 05:34:58.063373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 682/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:58.147455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:58.160064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-64cc6fb9-8b40-4b82-a80c-b13c4a105c94 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174302 Aug 05 05:34:58.160914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 671/1353] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:57 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:59.087641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:59.088585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:59.096829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:59.097391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:59.097892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:59.098687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:59.099205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:59.099693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:59.165385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:59.174202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7f5f26c9-771f-4ac4-b28e-801ce2a2d594 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093193 Aug 05 05:34:59.174781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 683/1354] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:34:59.183070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:34:59.183688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:34:59.190603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:59.191110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:59.191516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:59.192296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:34:59.192718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:34:59.193134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:34:59.326524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:34:59.335183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f65fd94a-be72-41c3-8f4a-952758967e27 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.156401 Aug 05 05:34:59.335785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 672/1355] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:34:59 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:00.202127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:00.203139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:00.214151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:00.214921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:00.215655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:00.216867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:00.217605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:00.218312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:00.283470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:00.291673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-60a1e61f-ce63-4352-b274-a9c704fb35f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096209 Aug 05 05:35:00.292291 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 684/1356] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:00.358633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:00.359705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:00.370180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:00.370961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:00.371671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:00.372834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:00.373572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:00.374269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:00.507190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:00.515255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a746a9cd-a606-4a98-806d-68f635394b03 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162638 Aug 05 05:35:00.516142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 673/1357] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:01.317550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:01.318528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:01.329060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:01.329839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:01.330540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:01.331726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:01.332496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:01.333185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:01.394816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:35:01.395847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:35:01.404363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:01.413259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-317fae6c-bd72-4957-95bc-9a399074553d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103420 Aug 05 05:35:01.413837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 685/1358] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:01.535106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:35:01.535435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:35:01.543817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:01.544524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:01.551478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:01.552016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:01.553020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:01.553134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:01.553573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:01.553991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:01.684590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:01.696547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9ce8d355-683f-4404-9632-06580101148e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158595 Aug 05 05:35:01.697362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 674/1359] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:01 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:02.434867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:02.435485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:02.442773 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:02.443273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:02.443743 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:02.444491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:02.444960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:02.445405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:02.463722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:02.509317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:02.517775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4ec11c06-3d3b-4f44-84a5-f81597e8b28c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087080 Aug 05 05:35:02.518343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 686/1360] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:02.722618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:02.723634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:02.734559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:02.735392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:02.736179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:02.737317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:02.738058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:02.738755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:02.879459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:02.891285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-31a17061-4534-4fa9-8ac6-e043bdb443fc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175311 Aug 05 05:35:02.892298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 675/1361] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:03.543320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:03.544353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:03.555303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:03.556200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:03.556923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:03.558057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:03.558717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:03.559143 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:03.621034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:03.629394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1eb5c919-40ab-4184-aebe-14325cdbe5b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092591 Aug 05 05:35:03.629963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 687/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:03.918062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:03.918656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:03.925507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:03.925993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:03.926427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:03.927123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:03.927570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:03.928023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:04.067942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:04.076461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8ba22171-ab86-4137-93ad-676c43acf3b0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165025 Aug 05 05:35:04.076987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 676/1363] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:03 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:04.655313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:04.656332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:04.667203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:04.668055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:04.668493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:04.669179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:04.669629 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:04.670050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:04.739015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:04.751242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-90c4c788-2a70-4382-8030-865895afd56a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.102304 Aug 05 05:35:04.751992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 688/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:05.101911 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:05.102947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:05.114329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:05.115149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:05.115878 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:05.117029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:05.117767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:05.118452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:05.254281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:05.265137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-90027f47-753e-4478-8ee8-63c159fa33d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169770 Aug 05 05:35:05.265705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 677/1365] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:05 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:05.777384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:05.778081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:05.786122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:05.786701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:05.787203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:05.788065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:05.788587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:05.789079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:05.857565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:05.866000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-69fd474a-3f5e-4c5f-8715-b7d3f840c675 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095731 Aug 05 05:35:05.866559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 689/1366] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:06.291054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:06.292048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:06.299651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:06.300186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:06.300633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:06.301349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:06.301809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:06.302246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:06.438186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:06.446424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c7479f0e-0fc3-46e3-8e55-ab2aeb1a0a5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161799 Aug 05 05:35:06.447000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 678/1367] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:06 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:06.891212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:06.892241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:06.896459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:06.905394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:06.906181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:06.906904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:06.908075 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:06.908815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:06.909505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:06.974615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:06.983158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e72401c3-a937-4819-85c8-21dcfd39fcd8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098502 Aug 05 05:35:06.984095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 690/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:07.472651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:07.473584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:07.483834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:07.484654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:07.485363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:07.486484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:07.487219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:07.487953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:07.631328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:07.639961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2a75868e-c05f-422c-890f-6d17c207c227 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174635 Aug 05 05:35:07.640530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 679/1369] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:07 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:08.007750 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:08.008793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:08.020384 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:08.021441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:08.022247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:08.023389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:08.024197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:08.025102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:08.105321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:08.117583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b9ff6ae8-a55d-4648-97f9-baf59b96a6aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.116054 Aug 05 05:35:08.118321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 691/1370] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:08.666155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:08.666820 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:08.676005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:08.676491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:08.676919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:08.677633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:08.678077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:08.678491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:08.813057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:08.821622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4d40054e-01bf-41aa-9da7-33c42c1b635c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162105 Aug 05 05:35:08.822159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 680/1371] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:08 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:09.141071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:09.141688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:09.148906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:09.149404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:09.149846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:09.150533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:09.150979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:09.151402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:09.218298 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:09.226537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-169c93f5-2578-4d2d-93f5-06127b1826f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090344 Aug 05 05:35:09.227102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 692/1372] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:09.846273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:09.847228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:09.858035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:09.858554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:09.858975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:09.859660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:09.860126 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:09.860539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:09.997671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:10.005846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-181f57f3-6cfd-4b1b-8bf9-95bddeeb8a0c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166130 Aug 05 05:35:10.006383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 681/1373] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:09 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:10.251081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:10.252181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:10.263117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:10.263976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:10.264695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:10.265828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:10.266566 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:10.267269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:10.335601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:10.344088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e0b25f65-dfcb-4954-9f22-37c1c92f7722 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099547 Aug 05 05:35:10.344672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 693/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:11.030686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:11.031270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:11.033655 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:11.039216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:11.039693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:11.040154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:11.040839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:11.041293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:11.041704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:11.178066 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:11.186833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cdc6d454-8e48-4414-af46-3db251ef915d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162402 Aug 05 05:35:11.187395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 682/1375] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:11 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:11.369874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:11.370711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:11.381710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:11.382510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:11.383226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:11.384420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:11.385168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:11.385870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:11.465161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:11.477217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9260da7a-c808-429b-98c2-f5c9857dd3da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.113690 Aug 05 05:35:11.478022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 694/1376] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:12.212346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:12.213346 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:12.224804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:12.225603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:12.226306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:12.227424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:12.228216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:12.228906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:12.234449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:12.359077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:12.367073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-43d5f3f4-b99b-4583-b0db-31e11cedc7d2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161383 Aug 05 05:35:12.367636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 683/1377] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:12 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:12.504441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:12.505496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:12.516335 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:12.517129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:12.517844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:12.518973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:12.519726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:12.520858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:12.588149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:12.596476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-52559d3c-7f36-4453-beda-84730753160f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098808 Aug 05 05:35:12.597038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 695/1378] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:13.392492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:13.393362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:13.404811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:13.405297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:13.405730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:13.406424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:13.406872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:13.407295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:13.548581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:13.556891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-feb6879d-f1b2-4bf4-ab69-eae587cfb1df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171244 Aug 05 05:35:13.557653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 684/1379] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:13 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:13.621226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:13.622235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:13.633217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:13.634014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:13.634731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:13.635913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:13.636666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:13.637370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:13.701017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:13.709406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1bb8b55d-4336-41a9-b294-1671f716ccf0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094689 Aug 05 05:35:13.709976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 696/1380] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:14.581204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:14.582055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:14.592520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:14.593007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:14.593437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:14.594125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:14.594573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:14.594995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:14.730438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:14.731079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:14.738004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:14.738502 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:14.738992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:14.739415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:14.740139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:14.740583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:14.741584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:14.746225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-515f6912-9a7d-41b5-97a9-6bf731de77e1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171463 Aug 05 05:35:14.746798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 685/1381] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:14 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:14.808434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:14.816827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6ec3bbdb-a210-4ecb-8d5a-06de1163c528 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090361 Aug 05 05:35:14.817371 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 697/1382] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:15.772059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:15.773111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:15.784134 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:15.784927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:15.785643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:15.786781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:15.787525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:15.788268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:15.839073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:15.839851 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:15.846470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:15.846939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:15.847407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:15.848165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:15.848594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:15.849022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:15.924023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:15.932931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-87b7869e-53a6-4f12-a0bb-8f515b651e19 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097847 Aug 05 05:35:15.933513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 698/1383] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:15.948183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:15.957677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-67cac3a7-4064-488d-84ea-a2d12af29d19 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.192632 Aug 05 05:35:15.958196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 686/1384] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:15 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:16.958671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:16.959615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:16.969647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:16.970347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:16.970511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:16.971255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:16.971706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:16.972160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:16.979121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:16.979728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:16.986593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:16.987072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:16.987504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:16.988263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:16.988705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:16.989121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:17.037498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:17.046154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8d885b0d-7feb-4bdb-8e2c-32af4d7ae568 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094020 Aug 05 05:35:17.046775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 699/1385] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:17.137168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:17.145821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7cbe59c6-289f-4115-9804-4848bd16fdf2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170964 Aug 05 05:35:17.146387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 687/1386] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:16 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:18.070118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:18.070976 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:18.079974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:18.080452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:18.080879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:18.081560 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:18.082002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:18.082420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:18.152760 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:18.160931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-30ad5620-34e9-4235-a04e-42d2cd5dcb58 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096425 Aug 05 05:35:18.161491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 700/1387] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:18.166802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:18.167407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:18.174325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:18.174798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:18.175253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:18.175978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:18.176433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:18.176831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:18.310566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:18.319307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d44d3ec4-692d-429e-9eaf-056346436463 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.156423 Aug 05 05:35:18.319973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 688/1388] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:18 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:19.126936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:35:19.126936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:35:19.180858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:19.181470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:19.188412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:19.188890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:19.189322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:19.190005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:19.190456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:19.190884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:19.261579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:19.270351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2f7c407a-5865-4ecb-a6e7-461d61d24ee1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092921 Aug 05 05:35:19.270921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 701/1389] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:19.349726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:19.350780 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:19.361743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:19.362531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:19.363243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:19.364413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:19.365183 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:19.365885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:19.500658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:19.509001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e14ab76a-ccca-4c64-ac59-acc0ea55a782 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165819 Aug 05 05:35:19.509549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 689/1390] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:19 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:20.295906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:20.296802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:20.304361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:20.304898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:20.305375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:20.306141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:20.306635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:20.307098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:20.369779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:20.377978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9ea565b6-171f-4b93-9a6d-d84ea8c3c27b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088794 Aug 05 05:35:20.378546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 702/1391] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:20.534848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:20.535993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:20.546869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:20.547293 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:20.547723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:20.548454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:20.548901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:20.549326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:20.684631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:20.693156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3887b796-6b3b-41ad-996f-c772fca7958f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165046 Aug 05 05:35:20.693738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 690/1392] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:20 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:21.403703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:21.404625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:21.412810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:21.413294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:21.413722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:21.414413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:21.414863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:21.415282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:21.419303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:21.477813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:21.486211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f275aaea-c09c-478f-a2ae-32564f6e278d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089168 Aug 05 05:35:21.486779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 703/1393] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:21.718626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:21.719643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:21.730478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:21.731271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:21.732055 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:21.733203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:21.733957 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:21.734651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:21.873289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:21.885759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bd5d16c7-711f-4536-bb31-97c36300f2ea tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.173475 Aug 05 05:35:21.886576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 691/1394] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:21 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:21.954172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:35:21.954357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:35:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:35:22.510892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:22.512026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:22.521297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:22.521771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:22.522193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:22.522874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:22.523314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:22.523730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:22.594544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:22.602889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3835b0ec-3c4c-40ed-bb7d-a6378acc74c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098733 Aug 05 05:35:22.603427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 704/1395] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:22.911656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:22.912710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:22.923519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:22.924490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:22.925205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:22.926326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:22.927062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:22.927744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:23.067106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:23.079441 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d588ea8c-9377-4c26-b3aa-5eed6e081c09 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174246 Aug 05 05:35:23.080218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 692/1396] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:22 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:23.627622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:23.628431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:23.635340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:23.635857 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:23.636295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:23.636988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:23.637441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:23.637865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:23.698905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:23.707419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ca5a60f0-2cbf-4a42-9064-042fee9b43b4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.086020 Aug 05 05:35:23.708119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 705/1397] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:24.109953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:24.110948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:24.118615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:24.119146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:24.119614 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:24.120406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:24.120900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:24.121361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:24.257072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:24.270572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-078f5ee6-b426-4a49-a4e5-d9773c1b0741 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166449 Aug 05 05:35:24.271392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 693/1398] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:24 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:24.733044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:24.734005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:24.742102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:24.742579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:24.743009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:24.743692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:24.744181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:24.744600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:24.814545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:24.823068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e3867095-7b47-4100-bcbd-bc9839c804e3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096672 Aug 05 05:35:24.823630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 706/1399] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:25.296389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:25.297284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:25.308170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:25.308971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:25.309699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:25.310836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:25.311579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:25.312333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:25.448018 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:25.456618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-69a723b1-0406-4434-b2c2-8c8f698d2c56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167022 Aug 05 05:35:25.457189 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 694/1400] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:25 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:25.847189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:25.848004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:25.857013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:25.857722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:25.858295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:25.859206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:25.859815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:25.860382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:25.925640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:25.933774 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f284b4cd-6555-44ae-876f-ed9f8b6561cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092986 Aug 05 05:35:25.934339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 707/1401] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:26.478113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:26.478705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:26.485907 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:26.486576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:26.487006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:26.487711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:26.488185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:26.488600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:26.622835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:26.631286 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8d4f727d-dac4-4322-8de3-0a3c1cd8bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157229 Aug 05 05:35:26.631910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 695/1402] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:26 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:26.961519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:26.962481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:26.973662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:26.974446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:26.975195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:26.976348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:26.977607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:26.977789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:27.052809 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:27.061396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-73853999-d5ec-4ada-b731-b08529dfec6e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.106934 Aug 05 05:35:27.061989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 708/1403] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:27.656605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:27.657537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:27.668403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:27.669298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:27.670005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:27.671122 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:27.671862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:27.672596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:27.810363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:27.818444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-92623177-cafe-4b16-9cb9-ddd06fbeb98d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168582 Aug 05 05:35:27.819220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 696/1404] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:27 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:28.082709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:28.083375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:28.091008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:28.091663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:28.092187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:28.092980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:28.093438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:28.093937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:28.164046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:28.172295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5e53022c-10cf-4f90-b9e7-16569ba4a819 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094526 Aug 05 05:35:28.172901 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 709/1405] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:35:28.840230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:28.840821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:28.847330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:28.847834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:28.848273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:28.848956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:28.849402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:28.849820 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:28.999810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:29.008609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-81fe946b-f80e-45f1-9f9a-0fe388477ef8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.172601 Aug 05 05:35:29.009192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 697/1406] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:28 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:29.197645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:29.198579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:29.207966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:29.208451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:29.208882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:29.209578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:29.210027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:29.210450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:29.272873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:29.281073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c9a558ea-ee06-408f-b328-fb58cc2708ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090074 Aug 05 05:35:29.281638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 710/1407] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:30.030216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:30.030828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:30.037870 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:30.038356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:30.038874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:30.039708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:30.040190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:30.040753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:30.178562 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:30.186644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-77f69cc2-1d9e-4d36-aeff-0fcf07ef5f41 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160366 Aug 05 05:35:30.187220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 698/1408] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:30 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:30.306666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:30.307519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:30.317949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:30.318427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:30.318856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:30.319539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:30.320023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:30.320441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:30.385307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:30.393958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ccc423d0-88ce-4b06-8a79-184a5ef9c7cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094044 Aug 05 05:35:30.394522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 711/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:31.208838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:31.209474 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:31.216591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:31.217070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:31.217507 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:31.218192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:31.218634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:31.219052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:31.359014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:31.362551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:31.367880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8344288c-16ed-45ad-bc80-572eabdb8b0e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163054 Aug 05 05:35:31.368451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 699/1410] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:31 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:31.414855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:31.415486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:31.422124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:31.422603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:31.423043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:31.423727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:31.424215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:31.424633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:31.487131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:31.495477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0e2ff60b-0b3e-4f55-838e-9bcfb4512164 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084683 Aug 05 05:35:31.496078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 712/1411] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:32.398637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:32.399827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:32.412683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:32.413458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:32.414176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:32.415260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:32.415714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:32.416175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:32.516906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:32.517505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:32.524505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:32.524969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:32.525436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:32.526100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:32.526554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:32.526979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:32.563633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:32.572631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2c7d7a00-4656-4f01-9ed0-a0e71bbe3848 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.184990 Aug 05 05:35:32.573207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 700/1412] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:32 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:32.593222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:32.601529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-05ebfd3b-52f1-48a5-a49f-9dbbd1594cb8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088592 Aug 05 05:35:32.602109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 713/1413] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:33.594281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:33.595083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:33.604652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:33.605329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:33.605933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:33.606896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:33.607530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:33.608196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:33.624823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:33.626028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:33.632984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:33.634433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:33.635004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:33.635626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:33.636110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:33.636534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:33.714668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:33.723332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-592089fd-017e-4277-a809-7e101e9aae0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103412 Aug 05 05:35:33.723958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 714/1414] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:33.772860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:33.780869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7f2389dc-874f-4793-ad1d-cb654c80f8f5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.191675 Aug 05 05:35:33.781427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 701/1415] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:33 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:34.744802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:34.745451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:34.752281 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:34.752763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:34.753189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:34.753875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:34.754318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:34.754740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:34.802074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:34.802693 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:34.809452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:34.809928 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:34.810351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:34.811032 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:34.811473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:34.811899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:34.818784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:34.826928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dab32bd1-0ca0-49a0-a6af-38210b59e522 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.086131 Aug 05 05:35:34.827713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 715/1416] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:34.949885 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:34.961412 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-26f13d0c-dff1-4ea9-8acb-0f9dc5cb6ef5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163249 Aug 05 05:35:34.961992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 702/1417] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:34 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:35.848446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:35.849086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:35.856483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:35.856929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:35.857352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:35.858033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:35.858473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:35.858882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:35.921874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:35.930128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6048870c-353d-4c16-80db-35b377c7cb2e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.085687 Aug 05 05:35:35.930687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 716/1418] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:35.982778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:35.983518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:35.990403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:35.990887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:35.991317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:35.992045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:35.992495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:35.992913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:36.127579 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:36.136050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-95a2d1d0-de41-4cbf-8b39-de259c5568a3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157216 Aug 05 05:35:36.136627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 703/1419] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:35 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:36.955096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:36.955788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:36.958028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:36.964354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:36.964836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:36.965269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:36.965948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:36.966392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:36.966808 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:37.035977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:37.045161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6c6e29f1-51f6-4d77-b7a6-4ba5965e37ac tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095957 Aug 05 05:35:37.045712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 717/1420] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:37.158835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:37.159502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:37.166260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:37.166744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:37.167168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:37.167889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:37.168333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:37.168747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:37.298555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:37.306984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-42313b5a-f11f-4415-b159-3b9c612f12df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.152117 Aug 05 05:35:37.307595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 704/1421] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:37 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:38.069087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:38.070087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:38.080719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:38.081646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:38.082379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:38.083511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:38.084297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:38.084993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:38.153356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:38.161375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b06ff222-614f-428f-90ed-af3be3166d29 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098727 Aug 05 05:35:38.161937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 718/1422] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:38.330919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:38.331560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:38.339547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:38.340131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:38.340624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:38.341427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:38.341973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:38.342422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:38.477962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:38.486304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-febf2103-dd1e-411f-9317-a29241243f43 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161252 Aug 05 05:35:38.486866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 705/1423] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:38 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:39.184572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:39.185439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:39.195152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:39.195845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:39.196493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:39.197466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:39.198101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:39.198704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:39.261076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:39.264496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:39.270275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-05d521e2-516f-4598-8fc8-76883ec1ae5d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091074 Aug 05 05:35:39.270831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 719/1424] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:39.511291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:39.512198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:39.523852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:39.524654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:39.525372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:39.526502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:39.527252 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:39.528044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:39.669404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:39.678648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-43e41940-fb97-4884-9d0e-d886a7d80f8d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174005 Aug 05 05:35:39.679235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 706/1425] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:39 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:40.293327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:40.294120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:40.301481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:40.301965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:40.302396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:40.303088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:40.303537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:40.303999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:40.369536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:40.377892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-98fac307-f589-4047-9680-2dbaf32613fb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090014 Aug 05 05:35:40.378462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 720/1426] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:40.701755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:40.702440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:40.709630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:40.710115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:40.710542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:40.711255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:40.711702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:40.712154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:40.846709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:40.854733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9d9aacb-fe41-4f0a-a3c5-42336697f0de tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157978 Aug 05 05:35:40.855276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 707/1427] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:40 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:41.403592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:41.404545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:41.412303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:41.412786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:41.413223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:41.413913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:41.414363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:41.414782 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:41.484646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:41.493127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-30a8e8a9-509f-4bf0-a055-59d38fbc0961 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096234 Aug 05 05:35:41.493719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 721/1428] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:41.880080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:41.881059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:41.884745 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:41.892702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:41.893195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:41.893608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:41.894297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:41.895103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:41.895522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:42.043794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:42.053841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d977a797-ee92-4426-a135-f9f788bc89c2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.180281 Aug 05 05:35:42.054419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 708/1429] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:41 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:42.518267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:42.519376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:42.530849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:42.531654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:42.532432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:42.533577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:42.534321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:42.535026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:42.602348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:42.610866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-26401345-ca80-44ae-896f-5835c8e2259c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099374 Aug 05 05:35:42.611449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 722/1430] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:43.080287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:43.080998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:43.088703 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:43.089242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:43.089724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:43.090495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:43.090993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:43.091459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:43.224919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:43.233279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bf4dbd67-f99c-48b5-b68f-92b07bb75941 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158819 Aug 05 05:35:43.233859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 709/1431] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:43 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:43.635444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:43.637614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:43.648999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:43.649798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:43.650510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:43.651647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:43.652443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:43.653131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:43.723794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:43.732571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e67239ce-cf5a-4b1e-96e2-c1fac8962cd5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103604 Aug 05 05:35:43.733142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 723/1432] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:44.258828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:44.259723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:44.271049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:44.271851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:44.272610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:44.273741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:44.274483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:44.275179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:44.412845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:44.421088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ab016e26-1aaa-4b95-afbc-65b0e66330d0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168983 Aug 05 05:35:44.421661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 710/1433] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:44 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:44.757825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:44.758780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:44.768447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:44.768929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:44.769332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:44.770410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:44.770855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:44.771278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:44.835114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:44.843353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dfeb684f-5988-46cb-9d90-35a2efadceec tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092184 Aug 05 05:35:44.843958 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 724/1434] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:45.448213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:45.448821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:45.456093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:45.456609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:45.457162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:45.457896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:45.458357 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:45.458780 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:45.591255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:45.604263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-00439875-0eb5-458d-b0a6-57e6bf784ddd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159250 Aug 05 05:35:45.604960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 711/1435] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:45 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:45.868331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:45.869351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:45.878343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:45.878828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:45.879237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:45.879980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:45.880428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:45.880847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:45.941606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:45.950091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f3bd3940-fda6-449f-b6b8-32304116f715 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088228 Aug 05 05:35:45.950648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 725/1436] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:46.629914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:46.630908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:46.641715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:46.642514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:46.643235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:46.644765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:46.645615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:46.646310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:46.788371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:46.799166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-246f9a4b-e775-4cd9-8db1-ddc036fef01e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175984 Aug 05 05:35:46.799738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 712/1437] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:46 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:46.974611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:46.975687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:46.986021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:46.986505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:46.986943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:46.987639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:46.988127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:46.988551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:47.050419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:47.059889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e1674a70-f15c-4cf5-ae5f-b015d3af16fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091730 Aug 05 05:35:47.060461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 726/1438] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:47.823620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:47.824600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:47.835638 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:47.836484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:47.837201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:47.838317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:47.839048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:47.839739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:47.988319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:47.996674 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3057c6a2-39a3-4d12-bdc2-99dce64a13ad tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.179582 Aug 05 05:35:47.997253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 713/1439] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:47 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:48.085263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:48.086272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:48.097365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:48.098163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:48.098884 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:48.100140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:48.100891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:48.101594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:48.165806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:48.174073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-58cd7c0b-e525-4c39-9646-445b77742029 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095556 Aug 05 05:35:48.174564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 727/1440] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:49.020175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:49.020790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:49.027587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:49.028106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:49.028534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:49.029219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:49.029659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:49.030077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:49.160454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:49.172794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-14bee1ca-0824-417f-97e3-74d27a2c2458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157206 Aug 05 05:35:49.173458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 714/1441] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:49 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:49.194574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:49.195189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:49.201730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:49.202203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:49.202639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:49.203309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:49.203756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:49.204198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:49.264013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:49.272327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-baaf1fa2-0acb-4493-b573-31e263560d7e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.081681 Aug 05 05:35:49.272905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 728/1442] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:50.198178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:50.199185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:50.207530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:50.208052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:50.208479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:50.209156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:50.209597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:50.210012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:50.293877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:50.294485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:50.300981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:50.301425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:50.302088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:50.302984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:50.303426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:50.303848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:50.349766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:50.358244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-aa8ec4d9-86f6-4c3b-8dc1-85fd3376b570 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166606 Aug 05 05:35:50.358848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 715/1443] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:50 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:50.368830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:50.377238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ec3754d9-91c3-4561-8691-05c112b38bd9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087819 Aug 05 05:35:50.377783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 729/1444] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:51.383432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:51.384396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:51.395575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:51.396420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:51.397124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:51.398248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:51.398978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:51.399663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:51.401672 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:51.402704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:51.411212 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:51.411689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:51.412157 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:51.412823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:51.413299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:51.413722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:51.420941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:51.497551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:51.506119 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9bb1fa80-0131-44ba-b81b-ba717b85cbdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.111401 Aug 05 05:35:51.506805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 730/1445] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:51.556816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:51.564998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d7c3b8ba-527b-4abb-98dd-f3f77d380bdf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.188147 Aug 05 05:35:51.565556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 716/1446] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:51 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:52.531077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:52.532048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:52.542943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:52.543730 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:52.544486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:52.545610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:52.546352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:52.547055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:52.586029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:52.586627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:52.593216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:52.593699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:52.594123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:52.594821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:52.595257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:52.595672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:52.608613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:52.616898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bc5e8ea7-2771-417c-af2c-b7ba0bd639e4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092466 Aug 05 05:35:52.617462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 731/1447] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:52.724100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:52.732092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0c6c671b-3112-4511-8218-c1f0ec3f8f79 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.149936 Aug 05 05:35:52.732860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 717/1448] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:52 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:53.642140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:53.644615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:53.655574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:53.656416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:53.657126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:53.658252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:53.658989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:53.659791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:53.722690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:53.731168 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ed142b62-e9c1-4f47-a151-3ba6fe956818 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096105 Aug 05 05:35:53.731724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 732/1449] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:53.753565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:53.754757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:53.760767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:53.761250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:53.761671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:53.762352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:53.762792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:53.763254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:53.893797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:53.905126 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-33f0e5d4-6b37-4928-be1b-f172213189e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.155464 Aug 05 05:35:53.905661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 718/1450] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:53 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:54.756437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:54.757420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:54.768381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:54.769173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:54.770196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:54.770882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:54.771323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:54.771737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:54.843374 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:54.855479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f13f1ceb-4c0c-48a9-a724-869854965184 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105691 Aug 05 05:35:54.856496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 733/1451] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:54.931431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:54.932452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:54.943121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:54.943959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:54.944663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:54.945790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:54.946521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:54.947212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:55.087580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:55.095783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-155f02d7-673b-4e89-a30c-4125201b4ac9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170312 Aug 05 05:35:55.096367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 719/1452] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:55.881305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:55.881909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:55.888805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:55.889213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:55.889637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:55.890343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:55.890791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:55.891235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:55.961765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:55.970334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9c7eb2d7-e22b-4c33-8262-8f5692d4ecc5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094516 Aug 05 05:35:55.970914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 734/1453] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:56.121455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:56.122467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:56.133307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:56.134102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:56.134864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:56.136002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:56.136757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:56.137442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:56.281105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:56.291193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5e92a164-9a9b-4ce9-add6-dd28525cbe9d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.176450 Aug 05 05:35:56.291787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 720/1454] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:56.997158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:56.997158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:57.008383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:57.009188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:57.009919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:57.011072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:57.011831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:57.012575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:57.081109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:57.089449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c2235646-c238-468a-a0da-bc0980c1f982 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.100082 Aug 05 05:35:57.090025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 735/1455] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:57.313125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:57.313690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:57.320825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:57.321303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:57.321729 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:57.322407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:57.322854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:57.323266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:57.459063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:57.467564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d99e11e0-b9eb-4ef1-a588-a04e46d1e244 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158683 Aug 05 05:35:57.468193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 721/1456] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:57 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:58.114801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:58.115742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:58.126799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:58.127611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:58.128357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:58.129437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:58.129880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:58.130297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:58.148621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:35:58.194749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:58.207631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d75393a7-aec8-4a31-9b60-e1a443021d6f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099206 Aug 05 05:35:58.208509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 736/1457] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:58.493243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:58.494348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:58.505701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:58.506523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:58.507242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:58.508510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:58.509335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:58.510039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:58.651421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:58.659872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a62e6004-f18d-4a03-a711-2189f098e03d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.173422 Aug 05 05:35:58.660442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 722/1458] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:58 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:59.238509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:59.239486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:59.247184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:59.247685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:59.248170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:59.248889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:59.249361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:59.249829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:59.314064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:59.322151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-62ab26e2-e509-466b-8ad6-6448c9f5a93b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090277 Aug 05 05:35:59.322719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 737/1459] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:35:59.685157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:35:59.686249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:35:59.696695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:59.697175 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:59.697612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:59.698302 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:35:59.698747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:35:59.699165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:35:59.828622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:35:59.837335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-06f1d32b-fb94-45d1-933a-c41a88f765a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158829 Aug 05 05:35:59.837899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 723/1460] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:35:59 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:00.347407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:00.348345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:00.356461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:00.356947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:00.357382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:00.358083 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:00.358534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:00.358955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:00.431711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:00.440315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5fb224e6-80f6-4d1f-9acd-cfd56b5de4e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099638 Aug 05 05:36:00.440888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 738/1461] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:00.862505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:00.863462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:00.871971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:00.872481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:00.872923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:00.873641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:00.874104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:00.874537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:01.011408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:01.020376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9185438-ca00-44aa-913d-7d698e6e3ff2 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164415 Aug 05 05:36:01.020913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 724/1462] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:01.465728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:01.466815 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:01.477722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:01.478532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:01.479247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:01.480437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:01.481151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:01.481909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:01.549540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:01.558155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1ecdc764-4adc-48cd-94d4-38a6d800e7b1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099120 Aug 05 05:36:01.558699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 739/1463] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:02.042856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:02.043430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:02.050518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:02.050996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:02.051422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:02.052142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:02.052587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:02.053000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:02.199732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:02.211010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-30e3b7ea-7e13-4539-afe9-1dc3d01672a5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171759 Aug 05 05:36:02.212006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 725/1464] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:02.583186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:02.584251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:02.595122 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:02.595989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:02.596671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:02.597821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:02.598640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:02.599331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:02.663071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:02.671910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f0d25445-48ad-48f2-ad01-10afcb3c4540 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095153 Aug 05 05:36:02.672478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 740/1465] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:03.236471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:03.237536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:03.248522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:03.249274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:03.249976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:03.251192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:03.251833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:03.252559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:03.386197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:03.395142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ad1ae390-207d-4095-982d-bd53c5d3b068 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165216 Aug 05 05:36:03.395719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 726/1466] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:03 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:03.696965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:03.697905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:03.708991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:03.709783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:03.710503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:03.711660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:03.712512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:03.712953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:03.777882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:03.790858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-791de501-8a82-442d-9ebc-2ffc9ee71992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.100158 Aug 05 05:36:03.791619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 741/1467] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:04.420366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:04.421380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:04.431979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:04.432472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:04.432903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:04.433633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:04.434084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:04.434508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:04.572627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:04.580669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ebb0338c-8e6a-4096-9812-f483910d98df tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166788 Aug 05 05:36:04.581242 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 727/1468] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:04 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:04.816339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:04.817189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:04.825889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:04.826408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:04.826843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:04.827545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:04.828030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:04.828457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:04.900303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:04.908872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8f0c6ecd-bf0f-4a60-9dcd-f9a577ad5c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099359 Aug 05 05:36:04.909441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 742/1469] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:05.605198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:05.606038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:05.615742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:05.616545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:05.617179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:05.618166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:05.618842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:05.619344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:05.763094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:05.772748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7d6cdb8d-d909-45f4-b0ec-3e70f02a9fd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.173351 Aug 05 05:36:05.773332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 728/1470] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:05 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:05.933363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:05.933983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:05.941094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:05.941581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:05.942017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:05.942711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:05.943165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:05.943591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:06.007269 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:06.015816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0342b772-619a-495a-bd32-76892adfaf44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088163 Aug 05 05:36:06.016555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 743/1471] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:06.802298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:06.803248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:06.811389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:06.811902 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:06.812332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:06.813026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:06.813468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:06.813889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:06.940476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:06.948631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5f37ca84-81da-4c0c-9986-48395f5b249c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.153073 Aug 05 05:36:06.949199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 729/1472] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:06 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:07.038020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:07.038632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:07.041197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:07.046671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:07.047142 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:07.047565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:07.048302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:07.048742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:07.049150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:07.113861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:07.122333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5a3cfdde-1fd0-4185-8101-28074a8a3c4c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088237 Aug 05 05:36:07.122908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 744/1473] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:07.981050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:07.982030 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:07.992314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:07.993101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:07.993798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:07.994692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:07.995117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:07.995560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:08.130474 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:08.140689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-db1a2a83-c38f-47d9-99c1-0b9e623ee5ff tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166539 Aug 05 05:36:08.141248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 730/1474] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:07 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:08.143307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:08.143953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:08.150659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:08.151133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:08.151558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:08.152276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:08.152722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:08.153141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:08.222919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:08.232843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b8b01fad-6e4c-432b-9e3a-f51b57936865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093721 Aug 05 05:36:08.233391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 745/1475] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:09.166125 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:09.166707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:09.173669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:09.174155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:09.174611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:09.175308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:09.175744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:09.176196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:09.254236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:09.254788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:09.261453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:09.261927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:09.262360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:09.263046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:09.263490 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:09.263936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:09.319883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:09.328120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0ee1fb8f-3f68-4eee-a55b-a596f5588ef1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168690 Aug 05 05:36:09.328696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 731/1476] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:09 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:09.335240 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:09.343290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b62039a0-ad4f-4a3e-901b-abc7a098e82f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093101 Aug 05 05:36:09.343872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 746/1477] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:36:10.353627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:10.354485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:10.365381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:10.366178 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:10.366892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:10.367195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:10.368086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:10.368294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:10.368806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:10.369488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:10.375414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:10.375930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:10.376362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:10.377050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:10.377493 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:10.377911 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:10.456030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:10.464365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0d006840-5fa4-4271-9e49-d431337f5a96 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103619 Aug 05 05:36:10.464974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 747/1478] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:10.517613 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:10.526250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-70b91628-da49-40a6-9eba-a96905b9eb38 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.179425 Aug 05 05:36:10.526851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 732/1479] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:10 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:11.489376 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:11.493381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:11.501611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:11.502401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:11.503106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:11.504297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:11.505029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:11.505716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:11.546736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:11.547457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:11.554139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:11.554672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:11.555133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:11.555855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:11.556304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:11.556720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:11.560940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:11.839482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:11.848017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a48dfd18-87a1-4344-8b49-bb3cb0937e0f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.365080 Aug 05 05:36:11.848594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 748/1480] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:11.933515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:11.942482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d1057231-8754-42af-8d3e-d484089e279c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.399704 Aug 05 05:36:11.943057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 733/1481] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:11 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:12.873324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:12.874419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:12.885307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:12.885790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:12.886229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:12.886927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:12.887377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:12.887797 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:12.962530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:12.965707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:12.966415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:12.968819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:12.971302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a6ebe019-45bf-4ff7-ac92-dda8594a4dd1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.104615 Aug 05 05:36:12.972061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 749/1482] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:12.974754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:12.975307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:12.975730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:12.976521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:12.976966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:12.977369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:13.120006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:13.130925 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a026a7a1-482c-485e-a4fe-94ffc04d5a75 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168854 Aug 05 05:36:13.131560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 734/1483] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:12 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:13.994103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:13.994722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:14.001724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:14.002206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:14.002638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:14.003333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:14.003805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:14.004222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:14.068758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:14.076859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0ef1e90d-fadc-4d71-9617-0267eeeea6ce tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087876 Aug 05 05:36:14.077427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 750/1484] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:14.157371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:14.158319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:14.169590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:14.170379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:14.171088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:14.172251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:14.172990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:14.173683 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:14.310420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:14.318559 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f93318f4-7af5-45b0-9cce-0f155560501a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168231 Aug 05 05:36:14.319123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 735/1485] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:14 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:15.101849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:15.102798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:15.110619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:15.111147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:15.111617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:15.112414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:15.112904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:15.113400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:15.180028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:15.188102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3e82a6db-8185-41c1-99a8-5c00f5bf87c9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092716 Aug 05 05:36:15.188671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 751/1486] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:15.342082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:15.342804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:15.351806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:15.352455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:15.353034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:15.353897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:15.354349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:15.354774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:15.494695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:15.503451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dc9c145b-b3f3-49bb-b83d-504be2b722b5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166773 Aug 05 05:36:15.504076 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 736/1487] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:15 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:16.213500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:16.214194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:16.222622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:16.223215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:16.223742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:16.224639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:16.225191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:16.225707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:16.292997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:16.303540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-86e96cfa-86b8-49ce-b06d-9069fecb21b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096737 Aug 05 05:36:16.304155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 752/1488] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:16.525979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:16.527303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:16.533959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:16.534673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:16.535116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:16.535826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:16.536301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:16.536936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:16.669198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:16.677444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f644db21-0aec-4f40-b4d0-425f6bc27cd9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.156319 Aug 05 05:36:16.678013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 737/1489] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:16 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:17.330944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:17.331515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:17.341789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:17.342272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:17.342700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:17.343385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:17.343833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:17.344273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:17.348287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:17.410280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:17.420931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ea76d397-91ab-4ddc-b6cc-8b959dc832f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096869 Aug 05 05:36:17.421510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 753/1490] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:17.702595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:17.705732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:17.714296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:17.714772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:17.715198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:17.715932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:17.716386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:17.716804 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:17.852488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:17.861086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-651badce-8854-4156-9638-f87ca8e1061b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164762 Aug 05 05:36:17.861660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 738/1491] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:17 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:18.446636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:18.447710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:18.458668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:18.459459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:18.460224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:18.461346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:18.462078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:18.462770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:18.537215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:18.545583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9f8c6f22-d424-45eb-9bdb-d952bb4d87b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105734 Aug 05 05:36:18.546156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 754/1492] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:18.886194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:18.886755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:18.893376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:18.894200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:18.894661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:18.895348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:18.895759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:18.896222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:19.026254 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:19.034455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-16462e9a-0a19-482a-a239-59ce704e8f17 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154536 Aug 05 05:36:19.035005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 739/1493] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:18 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:19.571473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:19.572655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:19.581195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:19.581670 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:19.582104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:19.582775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:19.583193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:19.583618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:19.645862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:19.658205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-24af2e29-b4e8-4dc7-9f73-d057f1b2f15a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093522 Aug 05 05:36:19.658954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 755/1494] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:20.056022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:20.056605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:20.063666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:20.064174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:20.064603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:20.065285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:20.065725 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:20.066137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:20.199021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:20.208611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f47fb3ce-db85-4f72-917e-41c3d8b3cbb5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.156564 Aug 05 05:36:20.209170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 740/1495] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:20 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:20.687576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:20.688571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:20.699624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:20.700479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:20.701205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:20.702336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:20.703081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:20.703822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:20.771968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:20.780367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bbb80796-7aa9-4257-82d0-e5b35d4c5865 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099452 Aug 05 05:36:20.780952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 756/1496] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:21.234285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:21.234954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:21.241859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:21.242340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:21.242766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:21.243446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:21.243931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:21.244342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:21.384358 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:21.392462 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1fbade31-3484-470d-a5ce-4eeef2f968a7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164975 Aug 05 05:36:21.393037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 741/1497] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:21 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:21.805856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:21.806789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:21.817715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:21.818499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:21.819203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:21.820365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:21.821090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:21.821777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:21.897185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:21.909599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e284c387-312d-4759-981e-f20c61e519cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.110037 Aug 05 05:36:21.910473 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 757/1498] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:22.418314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:22.419375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:22.427469 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:22.427994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:22.428432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:22.429121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:22.429573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:22.429994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:22.560987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:22.573276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a28888e8-cf52-4b0c-99ec-ee9e48e90911 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161232 Aug 05 05:36:22.573855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 742/1499] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:22 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:22.938504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:22.939221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:22.947120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:22.947679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:22.948225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:22.949028 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:22.949547 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:22.950036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:23.015161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:23.024215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e82ed4d5-6bdd-4d29-8b74-2aeb6d0f8fe0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092137 Aug 05 05:36:23.024792 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 758/1500] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:23.600287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:23.601210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:23.613266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:23.614058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:23.614769 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:23.615936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:23.616670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:23.617361 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:23.759591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:23.768338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-20f77b82-a730-4fbb-8904-6f2a07b71318 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174729 Aug 05 05:36:23.771160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 743/1501] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:23 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:24.045068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:24.045673 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:24.052668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:24.053139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:24.053567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:24.054249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:24.054690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:24.055107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:24.115600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:24.123942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a357d6d0-951e-4680-8809-5e8754773976 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.082803 Aug 05 05:36:24.124517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 759/1502] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:24.797904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:24.798658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:24.807116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:24.807716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:24.808296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:24.809153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:24.809713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:24.810236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:24.947472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:24.956192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4f222154-00da-4127-bb2f-7b3b0da5cbd1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164595 Aug 05 05:36:24.956771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 744/1503] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:24 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:25.149190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:25.150166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:25.159337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:25.159861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:25.160295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:25.160987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:25.161439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:25.161860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:25.226696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:25.235043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d99177b5-b2f7-42c3-8466-43fe6d1f385a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093085 Aug 05 05:36:25.235633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 760/1504] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:25.981989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:25.982968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:25.993867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:25.994660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:25.995371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:25.996542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:25.997245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:25.997976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:26.132442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:26.144707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-507ef468-ea01-4335-ac34-04d572a154fa tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169345 Aug 05 05:36:26.145430 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 745/1505] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:25 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:26.260127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:26.261019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:26.269762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:26.270237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:26.270665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:26.271348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:26.271791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:26.272236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:26.333338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:26.341406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-73e23ba9-160a-4186-92b2-a0b7ce8ff75f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087889 Aug 05 05:36:26.341951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 761/1506] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:27.170141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:27.171132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:27.178574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:27.179056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:27.179480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:27.180272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:27.180723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:27.181132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:27.316501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:27.324740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cec47262-6e97-49ea-9abf-b0a0d7f6b486 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161122 Aug 05 05:36:27.325303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 746/1507] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:27 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:27.362542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:27.363130 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:27.369981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:27.370456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:27.370888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:27.371567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:27.372062 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:27.372479 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:27.433133 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:27.441261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0fa2429a-32bd-4c0a-b713-943c40ce6e16 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.082670 Aug 05 05:36:27.441848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 762/1508] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:28.357161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:28.358133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:28.368981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:28.369785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:28.370498 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:28.371629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:28.372418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:28.373115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:28.462965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:28.463579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:28.470440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:28.470919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:28.471349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:28.472063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:28.472492 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:28.472906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:28.505083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:28.513605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-207121c6-facd-4117-af07-a07340c826e5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163224 Aug 05 05:36:28.514381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 747/1509] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:28 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:28.539644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:28.548726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ad35306a-72b0-480a-be5a-54db6eeb3237 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089603 Aug 05 05:36:28.549297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 763/1510] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:29.536713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:29.537380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:29.544998 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:29.545532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:29.546005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:29.546765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:29.547259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:29.547722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:29.571381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:29.572763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:29.579617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:29.580187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:29.580683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:29.581417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:29.581924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:29.582424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:29.675260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:29.683618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aa977efe-6f86-4736-9bd2-1644a37d32a9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.117573 Aug 05 05:36:29.684511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 764/1511] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:29.705892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:29.714170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-740de3cb-a4b7-4174-a587-009d18737fae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.181881 Aug 05 05:36:29.714768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 748/1512] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:29 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:30.709276 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:30.710340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:30.721319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:30.722114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:30.722829 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:30.724027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:30.724775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:30.725526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:30.737609 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:30.738184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:30.744993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:30.745492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:30.745897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:30.746590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:30.747029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:30.747444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:30.793504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:30.802201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2032d17d-4ffb-4fcc-a889-20ac415af572 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099738 Aug 05 05:36:30.802751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 765/1513] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:30.889615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:30.893251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:30.898848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-868336aa-95d7-4c34-9704-5a4b6644fd63 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166112 Aug 05 05:36:30.899428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 749/1514] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:30 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:31.827365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:31.828830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:31.839206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:31.840058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:31.840764 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:31.841888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:31.842627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:31.843318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:31.911040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:31.919461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-40f5f8b1-6c23-47ce-a37e-af45ea94a29b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098603 Aug 05 05:36:31.920077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 766/1515] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:31.920406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:31.921020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:31.927629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:31.928155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:31.928585 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:31.929276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:31.929760 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:31.930152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:32.066284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:32.075019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-79c88ee6-2046-4416-9c42-d32509d496ee tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158867 Aug 05 05:36:32.075595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 750/1516] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:31 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:32.944759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:32.945724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:32.955513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:32.956027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:32.956454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:32.957128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:32.957571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:32.957984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:33.028685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:33.036902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bc6a8cac-1f79-46ba-acec-f36a918b7698 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098954 Aug 05 05:36:33.037466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 767/1517] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:33.099306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:33.100287 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:33.110217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:33.110687 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:33.111111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:33.111797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:33.112262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:33.112669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:33.231410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:36:33.231642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 (ip 10.222.0.30) !!! Aug 05 05:36:33.247603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:33.256216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e0e29209-bf77-46a3-938b-eba0671b341a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162869 Aug 05 05:36:33.256789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 751/1518] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:33 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:34.061208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:34.061792 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:34.068870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:34.069345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:34.069775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:34.070450 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:34.070902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:34.071317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:34.133555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:34.142038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-78f6eec2-5135-482e-be8e-f6408d82a8b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087135 Aug 05 05:36:34.142605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 768/1519] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:34.278642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:34.279199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:34.286160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:34.286610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:34.287071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:34.287758 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:34.288237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:34.288656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:34.423017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:34.431306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c7cae90e-39eb-42e2-9727-3c80380542bf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.156703 Aug 05 05:36:34.431915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 752/1520] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:34 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:35.167436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:35.168408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:35.176816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:35.177291 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:35.177722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:35.178401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:35.178842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:35.179255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:35.248950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:35.252368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:35.257805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-60bd6372-7129-4f28-953b-f7df1b1c7f2f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096885 Aug 05 05:36:35.258317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 769/1521] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:35.451964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:35.452543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:35.459375 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:35.459896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:35.460330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:35.461014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:35.461463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:35.461881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:35.597732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:35.610015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3b88e082-3bb7-49b2-9172-c6bf58b6f716 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161900 Aug 05 05:36:35.610810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 753/1522] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:35 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:36.283573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:36.284191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:36.291070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:36.291556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:36.292014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:36.292700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:36.293148 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:36.293567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:36.362749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:36.372380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-432eb4f4-9ee1-4259-8cda-09b63d59f223 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095122 Aug 05 05:36:36.373535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 770/1523] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:36.640281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:36.641170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:36.652396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:36.653187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:36.653900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:36.655029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:36.655828 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:36.656595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:36.794849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:36.803045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-895597f8-5794-4809-99d3-5f66578c308b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169438 Aug 05 05:36:36.803611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 754/1524] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:36 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:37.399055 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:37.400106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:37.403838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:37.410432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:37.410903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:37.411324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:37.412040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:37.412480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:37.413129 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:37.476100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:37.484147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7993511b-20cf-4141-97ca-3f9e4502766d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091946 Aug 05 05:36:37.484836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 771/1525] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:37.828117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:37.829059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:37.839460 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:37.840325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:37.841037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:37.842168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:37.842909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:37.843615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:37.979001 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:37.987415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1e42ac83-d794-41d6-b1ad-26e858c230d8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165792 Aug 05 05:36:37.987991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 755/1526] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:37 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:38.509590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:38.510532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:38.519474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:38.519985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:38.520407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:38.521088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:38.521525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:38.521942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:38.586380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:38.594534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-27cf05a1-5721-4747-b2a9-87bf8f15fc1c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091852 Aug 05 05:36:38.595074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 772/1527] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:39.014950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:39.017796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:39.028841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:39.029529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:39.030099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:39.031180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:39.031949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:39.032573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:39.180918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:39.189259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3a89af71-55a5-4864-9b5a-cff8a6441e52 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.180767 Aug 05 05:36:39.189848 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 756/1528] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:39 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:39.615630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:39.616279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:39.623074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:39.623546 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:39.624011 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:39.624723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:39.625263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:39.625711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:39.689432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:39.701273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9d3081df-8c5a-40d1-acf6-27e33ccb8b11 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089333 Aug 05 05:36:39.702031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 773/1529] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:40.209718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:40.210325 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:40.216923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:40.217402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:40.217824 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:40.218508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:40.219065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:40.219483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:40.350326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:40.360285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6216440e-fdaf-4245-a86d-f52c100580e3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154456 Aug 05 05:36:40.360852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 757/1530] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:40 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:40.727029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:40.728132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:40.738733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:40.739283 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:40.739970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:40.740962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:40.741521 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:40.742128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:40.810773 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:40.819488 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1a7d72a9-484b-4cec-afff-93157597c94b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098971 Aug 05 05:36:40.820095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 774/1531] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:40 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:41.385521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:41.386420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:41.395410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:41.395930 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:41.396359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:41.397047 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:41.397517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:41.397926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:41.533488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:41.541769 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8bcb04c6-59a6-492d-8002-e23b247944ed tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162935 Aug 05 05:36:41.542343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 758/1532] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:41 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:41.846807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:41.847443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:41.854338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:41.854813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:41.855239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:41.855973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:41.856412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:41.856824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:41.928215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:41.936787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6f308922-3eb6-4346-9ceb-7f5167a4831c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094295 Aug 05 05:36:41.937364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 775/1533] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:42.021925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:36:42.022093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:36:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:36:42.564908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:42.565552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:42.573779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:42.574263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:42.574691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:42.575380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:42.575880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:42.576311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:42.711486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:42.724011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e579126a-0cd4-420a-8522-dab3814b98cd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163190 Aug 05 05:36:42.724859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 759/1534] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:42 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:42.961394 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:42.962325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:42.973532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:42.974317 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:42.975029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:42.976222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:42.976956 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:42.977646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:43.042614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:43.050863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0f74cdbb-44a5-4735-9a2e-c62dce2f7906 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096283 Aug 05 05:36:43.051419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 776/1535] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:43.752929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:43.754036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:43.759297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:43.766554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:43.767036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:43.767473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:43.768188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:43.768999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:43.769400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:43.899947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:43.908393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eff32180-42f7-469f-8484-7fe72d3ad509 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161948 Aug 05 05:36:43.908970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 760/1536] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:43 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:44.076906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:44.077717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:44.088954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:44.089758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:44.090486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:44.091643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:44.092413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:44.093159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:44.157147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:44.165207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6da064cc-bba2-4a63-bec3-0a8261bcf539 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095712 Aug 05 05:36:44.165785 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 777/1537] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:44.933819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:44.934779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:44.945866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:44.946680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:44.947400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:44.949099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:44.949906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:44.950612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:45.087083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:45.099258 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-312e2bdb-ac66-4dba-b0f6-281a4ca6acf9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171815 Aug 05 05:36:45.100218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 761/1538] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:44 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:45.189868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:45.190710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:45.201695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:45.202460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:45.203272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:45.204001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:45.204446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:45.204871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:45.278405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:45.287197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0a03416e-8bb7-41a7-a49a-92d9a95524c0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.104002 Aug 05 05:36:45.287804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 778/1539] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:46.124979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:46.125601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:46.132659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:46.133148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:46.133581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:46.134272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:46.134723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:46.135142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:46.271663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:46.280272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-50643a4f-7eb9-4701-ba25-37e0632609bb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159343 Aug 05 05:36:46.280817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 762/1540] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:46 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:46.308837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:46.309421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:46.316316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:46.316762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:46.317226 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:46.317909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:46.318345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:46.318756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:46.389379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:46.402099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3c23d07a-1a65-4e2c-9939-58e74ee87dfa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096972 Aug 05 05:36:46.402864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 779/1541] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:47.305797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:47.306740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:47.317647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:47.318458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:47.319184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:47.320394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:47.321142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:47.321840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:47.424690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:47.425327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:47.432203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:47.432681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:47.433114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:47.433795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:47.434235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:47.434648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:47.453400 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:47.461549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-728230dd-b1b6-4070-ad12-a69da8bf0c33 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162403 Aug 05 05:36:47.462115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 763/1542] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:47 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:47.496499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:47.504548 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-155bf2a1-9e20-452e-b82b-cd9625f85385 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084365 Aug 05 05:36:47.505082 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 780/1543] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:48.486750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:48.487802 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:48.498948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:48.499738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:48.500397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:48.501077 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:48.501520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:48.501932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:48.525728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:48.526288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:48.533414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:48.533883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:48.534307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:48.534992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:48.535434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:48.535875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:48.601542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:48.609642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a7b7fa62-1fc6-4b1b-a9f7-130c7a7e38a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087796 Aug 05 05:36:48.610214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 781/1544] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:48.666833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:48.675626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-65c2c101-4943-4811-a395-d318d3d9b54d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.195305 Aug 05 05:36:48.676200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 764/1545] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:48 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:49.634770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:49.635724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:49.644814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:49.645320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:49.645729 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:49.646410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:49.646854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:49.647255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:49.696103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:49.696712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:49.703549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:49.704057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:49.704481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:49.705166 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:49.705591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:49.706004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:49.713619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:49.721946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-68b35f15-5841-4e28-877f-6f91b044702a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093714 Aug 05 05:36:49.722519 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 782/1546] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:49.842386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:49.850949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-19f91fcb-ad9e-49cb-b3a3-c629f98a0cda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158730 Aug 05 05:36:49.851519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 765/1547] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:49 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:50.747435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:50.748463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:50.756683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:50.757165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:50.757602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:50.758290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:50.758742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:50.759164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:50.824476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:50.833232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5f7b509c-fbc7-4b06-9a5b-be1b0c927c67 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092693 Aug 05 05:36:50.833906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 783/1548] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:50 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:50.875913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:50.876983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:50.887823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:50.888666 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:50.889372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:50.890495 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:50.891226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:50.891972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:50.910558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:51.036677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:51.044963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9b8fcd3a-ced1-4644-b279-7fe30df2b753 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175648 Aug 05 05:36:51.045545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 766/1549] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:50 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:51.859074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:51.860126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:51.868100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:51.868578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:51.869008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:51.869693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:51.870140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:51.870557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:51.935997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:51.944648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-98f4b520-9f33-4652-a267-da713d67e7ba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092125 Aug 05 05:36:51.945220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 784/1550] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:52.066403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:52.066984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:52.073826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:52.074306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:52.074733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:52.075422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:52.075919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:52.076333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:52.216052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:52.224446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f7d11cc7-74da-4518-9145-b974497c0b51 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162152 Aug 05 05:36:52.225009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 767/1551] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:52 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:52.970163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:52.971141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:52.978943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:52.979443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:52.979930 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:52.980643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:52.981106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:52.981542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:53.044202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:53.052380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-de22c8b9-2a7e-466f-b348-0c503b57caf7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089206 Aug 05 05:36:53.052909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 785/1552] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:53.248982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:53.249909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:53.260838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:53.261643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:53.262452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:53.263587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:53.264377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:53.265084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:53.409719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:53.418392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1d92b9fd-c89c-4c99-93c8-76d56d78ad2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.176245 Aug 05 05:36:53.418959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 768/1553] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:53 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:54.077543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:54.078433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:54.087361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:54.087879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:54.088323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:54.089014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:54.089468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:54.089900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:54.108180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:36:54.152759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:54.160962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e6a00a62-3bb4-4142-91b4-5c5cbfd8f7e5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090175 Aug 05 05:36:54.161590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 786/1554] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:54.443449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:54.444118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:54.451607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:54.452177 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:54.452662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:54.453403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:54.453910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:54.454402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:54.586253 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:54.594422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-43ee0c75-d008-4b13-829d-869111095336 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157443 Aug 05 05:36:54.594989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 769/1555] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:55.186405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:55.187264 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:55.196170 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:55.196646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:55.197076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:55.197754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:55.198201 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:55.198614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:55.272002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:55.280383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3ad79414-7935-48e5-92ae-993c38b71370 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.100790 Aug 05 05:36:55.280946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 787/1556] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:55.618983 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:55.620321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:55.629182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:55.629785 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:55.630324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:55.631186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:55.631944 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:55.632473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:55.764002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:55.772736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3e9366cc-1dba-4918-9168-4a8c59ce3803 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159262 Aug 05 05:36:55.773283 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 770/1557] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:55 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:56.305991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:56.306870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:56.317761 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:56.318562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:56.319268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:56.320451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:56.321207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:56.321907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:56.391103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:56.406841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b674bedf-9193-4670-a2f9-9b1bb1ca3e91 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.107700 Aug 05 05:36:56.407742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 788/1558] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:56.800577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:56.801548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:56.809728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:56.810205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:56.810629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:56.811303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:56.811749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:56.812196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:56.951681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:56.960050 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-72210b5c-df7e-47a2-ba72-30a135bf0cd7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165899 Aug 05 05:36:56.960719 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 771/1559] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:57.434200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:57.436940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:57.445324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:57.445803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:57.446286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:57.447204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:57.447824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:57.448416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:57.518705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:57.529337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0e533383-2672-4aaf-8d77-e9742a1fdc44 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101177 Aug 05 05:36:57.529904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 789/1560] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:57.985393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:57.986316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:57.997296 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:57.998100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:57.998815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:58.000003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:58.000754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:58.001419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:58.133757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:58.142212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5563fae9-855e-47a4-b85f-3351dc77e30c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163365 Aug 05 05:36:58.142791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 772/1561] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:57 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:58.555001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:58.556068 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:58.563165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:58.563675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:58.564131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:58.564814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:58.565254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:58.565666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:58.634025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:58.642595 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9f36402c-a2a6-46de-9ab6-cf0fa5078007 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094561 Aug 05 05:36:58.643162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 790/1562] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:59.172882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:59.173929 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:59.183046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:59.183522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:59.183991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:59.184675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:59.185114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:59.185535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:59.316928 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:59.326631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c2335367-8d02-49d8-9677-ea881abf69ae tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160404 Aug 05 05:36:59.327211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 773/1563] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:59 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:36:59.667101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:36:59.667885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:36:59.675605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:59.676196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:59.676702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:59.677529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:36:59.678046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:36:59.678537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:36:59.741354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:36:59.749786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f9e2141b-b135-40ca-bd83-a86afa2536dc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088569 Aug 05 05:36:59.750350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 791/1564] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:36:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:00.351696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:00.352711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:00.360463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:00.360996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:00.361484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:00.362244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:00.362740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:00.363208 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:00.500313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:00.513740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6c56e12f-86d6-4265-95d2-3aaa05d6a06c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167860 Aug 05 05:37:00.514959 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 774/1565] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:00.775092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:00.775860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:00.784359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:00.784959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:00.785494 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:00.786351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:00.786905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:00.787429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:00.853227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:00.861558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e1baf832-0f3b-47b4-899d-493b89d0b29e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093468 Aug 05 05:37:00.862134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 792/1566] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:00 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:01.540213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:01.541491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:01.552515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:01.553313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:01.554024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:01.555163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:01.556013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:01.556438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:01.689598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:01.697861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6428670c-fc46-4073-a82d-6099d04dc1cb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164220 Aug 05 05:37:01.698426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 775/1567] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:01 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:01.885594 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:01.886287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:01.895435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:01.896112 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:01.896691 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:01.897577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:01.898167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:01.898717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:01.977324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:01.985800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b352d2fe-82b6-4afb-b9d1-0911d5ac6f0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.106685 Aug 05 05:37:01.986372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 793/1568] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:02.722801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:02.723864 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:02.735168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:02.736025 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:02.736753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:02.737945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:02.738697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:02.739405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:02.874931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:02.887846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d746d658-afe8-4fe6-8ddf-0bf952cf549e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171309 Aug 05 05:37:02.888741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 776/1569] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:03.011135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:03.012199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:03.023378 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:03.024238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:03.024917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:03.025616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:03.026076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:03.026498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:03.089881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:03.102167 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2a8634d8-989a-4849-83f2-48be6b90c919 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097456 Aug 05 05:37:03.103021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 794/1570] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:03.917138 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:03.918150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:03.928926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:03.929713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:03.930417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:03.931536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:03.932333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:03.933022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:04.081733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:04.095098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-397399e0-8e7a-492c-9d44-9d736efaa48e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.184350 Aug 05 05:37:04.095889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 777/1571] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:03 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:04.122644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:04.123259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:04.130130 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:04.130646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:04.131071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:04.131794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:04.132251 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:04.132655 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:04.195667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:04.204004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d2a9f9ac-7114-4704-aa75-94b9588d6d68 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.085203 Aug 05 05:37:04.204571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 795/1572] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:05.123439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:05.124483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:05.135319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:05.136181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:05.136858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:05.138015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:05.138748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:05.139433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:05.224836 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:05.225445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:05.232751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:05.233220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:05.233643 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:05.234326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:05.234775 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:05.235185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:05.284466 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:05.292906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6b1165e-8584-4fcc-91e8-494e3d5dd91b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.176030 Aug 05 05:37:05.293453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 778/1573] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:05 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:05.300172 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:05.308400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9fbd6f83-5be9-4e5c-b3da-0e61d787cba3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087482 Aug 05 05:37:05.308950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 796/1574] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:37:06.318607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:06.319472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:06.327148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:06.327600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:06.328092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:06.328784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:06.329230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:06.329657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:06.332646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:06.333236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:06.341199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:06.341674 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:06.342096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:06.342784 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:06.343224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:06.343639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:06.428154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:06.436663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-82c2d817-176d-4304-acb6-f421c96528e1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.110556 Aug 05 05:37:06.437215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 797/1575] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:06.487491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:06.495630 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b4f1cfbc-6516-4239-8bf6-d5d51146c2ce tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.183850 Aug 05 05:37:06.496239 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 779/1576] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:06 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:07.460991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:07.462065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:07.464872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:07.471160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:07.471699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:07.472216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:07.472987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:07.473486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:07.473960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:07.516797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:07.517338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:07.524224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:07.524765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:07.525198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:07.525894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:07.526340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:07.526758 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:07.538237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:07.546648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-898f5ff2-bf4f-4e2e-86eb-62e7d30b463f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092267 Aug 05 05:37:07.547229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 798/1577] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:07.660371 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:07.677381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-afafbab5-50ee-421d-8dcd-8a9cc87eb83f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164493 Aug 05 05:37:07.677970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 780/1578] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:07 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:08.571539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:08.572270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:08.579759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:08.580386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:08.580896 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:08.581701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:08.582230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:08.582724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:08.647732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:08.656016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f837cdc3-c410-406b-b3c5-881c2216cd6d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091096 Aug 05 05:37:08.656588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 799/1579] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:08.698241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:08.698812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:08.705671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:08.706146 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:08.706600 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:08.707280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:08.707754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:08.708198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:08.848294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:08.856372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0827868e-1d68-4f26-a16c-346e02005fe9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162025 Aug 05 05:37:08.856968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 781/1580] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:08 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:09.680710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:09.681446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:09.689557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:09.690118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:09.690623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:09.691430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:09.691997 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:09.692489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:09.761478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:09.770118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-80f64623-1b9e-4198-9634-62c25b392eba tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.096184 Aug 05 05:37:09.770683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 800/1581] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:09 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:09.881451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:09.882441 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:09.890418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:09.890948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:09.891419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:09.892212 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:09.892710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:09.893522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:10.026265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:10.034645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2825d1b9-d69d-4493-94bb-8045b1d5273e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159721 Aug 05 05:37:10.035248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 782/1582] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:09 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:10.795481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:10.796487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:10.807467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:10.808297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:10.809022 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:10.810154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:10.810893 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:10.811568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:10.884553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:10.893714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-49db9b6b-16e6-49bf-b55e-6f486441207a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.104470 Aug 05 05:37:10.894295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 801/1583] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:11.056448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:11.057074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:11.064013 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:11.064499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:11.064935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:11.065642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:11.066091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:11.066515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:11.070552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:11.203218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:11.211413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-06af99ea-e940-4f74-8e8f-00cbd454c3a9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158965 Aug 05 05:37:11.212122 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 783/1584] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:11 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:11.918886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:11.919871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:11.930898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:11.931380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:11.931798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:11.932559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:11.932993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:11.933425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:12.006419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:12.016010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aeb51e8b-dd1f-4833-aae5-a731a110ef43 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103757 Aug 05 05:37:12.016598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 802/1585] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:12.244096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:12.244977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:12.255835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:12.256661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:12.257374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:12.258557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:12.259208 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:12.259625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:12.400279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:12.409012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-845662ee-1d3a-4bc9-b12e-6f176b7b3d8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171640 Aug 05 05:37:12.409592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 784/1586] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:12 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:13.038850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:13.039564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:13.046627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:13.047107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:13.047534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:13.048262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:13.048709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:13.049120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:13.053089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:13.116889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:13.125478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c24a6187-ebdc-4082-8087-8e819b86e312 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091348 Aug 05 05:37:13.126101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 803/1587] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:13.434448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:13.435386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:13.448106 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:13.448895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:13.449577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:13.450712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:13.451447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:13.452221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:13.603916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:13.612276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5c2d137a-a0e9-4df8-9dc3-1cd89dd824a0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.184510 Aug 05 05:37:13.612856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 785/1588] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:13 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:14.150926 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:14.151523 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:14.158700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:14.159186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:14.159614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:14.160350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:14.160798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:14.161218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:14.227988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:14.236551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1bc3d0ba-301e-4060-8d70-7a2cf401bd57 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091356 Aug 05 05:37:14.237121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 804/1589] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:14.636768 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:14.637720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:14.641390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:14.650451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:14.651248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:14.652010 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:14.653144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:14.653895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:14.654705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:14.799310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:14.807794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9417a0ed-ca57-41df-b7c7-e50b5dca6b56 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.177753 Aug 05 05:37:14.808389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 786/1590] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:14 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:15.261874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:15.262706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:15.273966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:15.274762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:15.275474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:15.276704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:15.277437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:15.278144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:15.343683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:15.352188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c83dbe06-1ae9-47fa-a158-ded97670f830 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097091 Aug 05 05:37:15.352826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 805/1591] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:15.832594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:15.833519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:15.842464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:15.842953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:15.843382 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:15.844102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:15.844551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:15.844967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:15.983161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:15.994370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c3079eb6-f1dd-43cc-82d8-d94f137d9735 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167695 Aug 05 05:37:15.994918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 787/1592] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:15 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:16.377432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:16.378467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:16.389446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:16.390236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:16.390959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:16.392165 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:16.392902 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:16.393991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:16.460586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:16.468791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-48b3ce1c-68e8-4312-8cca-b8eb0d6a0801 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098067 Aug 05 05:37:16.469428 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 806/1593] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:17.020333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:17.021337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:17.029383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:17.029842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:17.030273 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:17.030965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:17.031408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:17.031862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:17.160631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:17.173144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7a04899d-c89d-4999-8d60-b2e083cdcc3c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159533 Aug 05 05:37:17.173710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 788/1594] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:17 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:17.500418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:17.501524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:17.511125 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:17.511605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:17.512062 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:17.512747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:17.513191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:17.513610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:17.575511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:17.583675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1b7dbd84-acc9-43c6-a8fc-3744dc8aa6c2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089795 Aug 05 05:37:17.584284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 807/1595] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:18.201115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:18.202116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:18.213027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:18.213827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:18.214543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:18.215676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:18.216471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:18.217173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:18.353502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:18.362169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fd0ece50-059e-4ef1-8eb9-91de91c01b8e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167794 Aug 05 05:37:18.362737 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 789/1596] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:18 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:18.607870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:18.608456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:18.618464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:18.618946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:18.619398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:18.620105 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:18.620552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:18.620973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:18.691942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:18.700193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a53e7a3f-76b3-4fc3-a72f-82b1511ced00 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097971 Aug 05 05:37:18.700766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 808/1597] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:19.386751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:19.387615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:19.398872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:19.399673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:19.400142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:19.400823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:19.401275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:19.401697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:19.536351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:19.547308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-da93abd9-2100-4f36-b15e-8c06b08a7c90 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167178 Aug 05 05:37:19.547877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 790/1598] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:19 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:19.725073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:19.726033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:19.733448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:19.733944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:19.734343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:19.735024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:19.735465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:19.735916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:19.801433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:19.809588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9d27a195-e15a-48de-97ee-0f2ed1245821 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091061 Aug 05 05:37:19.810169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 809/1599] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:19 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:20.573592 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:20.574283 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:20.582280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:20.582863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:20.583354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:20.584214 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:20.584736 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:20.585233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:20.722424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:20.733450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b25e722d-5069-4b09-a3f4-23ab2b431991 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165290 Aug 05 05:37:20.734126 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 791/1600] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:20 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:20.834495 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:20.835308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:20.843386 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:20.843959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:20.844430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:20.845184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:20.845675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:20.846135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:20.917019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:20.925206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fcc4d878-26c7-4fa2-8f9b-4e68cdd24b1b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097229 Aug 05 05:37:20.925778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 810/1601] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:21.759145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:21.760269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:21.771418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:21.772303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:21.773061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:21.774306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:21.774755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:21.775168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:21.912219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:21.920366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4baf2a8c-09da-4f55-9710-abeacaaa2209 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167866 Aug 05 05:37:21.920938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 792/1602] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:21 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:21.946569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:21.947156 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:21.953830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:21.954310 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:21.954738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:21.955421 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:21.955897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:21.956318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:22.022267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:22.032633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-55c79bb6-d919-4792-9319-db14375e81c8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089939 Aug 05 05:37:22.033216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 811/1603] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:37:22.945624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:22.946568 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:22.957340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:22.958130 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:22.958838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:22.960044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:22.960780 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:22.961467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:23.053559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:23.054180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:23.061027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:23.061543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:23.061972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:23.062662 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:23.063110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:23.063500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:23.091007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:23.099733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-19cb3935-3cef-4994-8861-1c95f9faf8c7 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160738 Aug 05 05:37:23.100335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 793/1604] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:22 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:23.127873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:23.136106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1b6c4d21-e0f7-46e1-8076-67771ffac922 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.086383 Aug 05 05:37:23.136645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 812/1605] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:24.124871 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:24.125910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:24.135808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:24.136316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:24.136741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:24.137446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:24.137887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:24.138333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:24.156299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:24.156919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:24.163615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:24.164131 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:24.164561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:24.165327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:24.165772 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:24.166220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:24.232653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:24.240771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-61ac9a9c-fdb2-430f-bf51-7ac6d7353e35 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088312 Aug 05 05:37:24.241611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 813/1606] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:24.290251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:24.298305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f7d1b3b3-5d6f-47bf-8cf8-440916ee9bda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.179918 Aug 05 05:37:24.298862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 794/1607] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:24 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:25.266304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:25.267177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:25.277366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:25.277843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:25.278268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:25.278954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:25.279401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:25.279796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:25.318598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:25.319194 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:25.326231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:25.326720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:25.327153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:25.327888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:25.328339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:25.328761 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:25.343518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:25.351838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5d5edc22-efdf-42a5-8a5a-3c7ff9e7fadf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092326 Aug 05 05:37:25.352448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 814/1608] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:25.459684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:25.468525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-edb99094-7224-44a0-a0ca-a43ff28f0458 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.153775 Aug 05 05:37:25.469105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 795/1609] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:25 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:26.377324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:26.378210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:26.387554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:26.388100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:26.388536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:26.389224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:26.389671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:26.390091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:26.452633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:26.460880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-badd5e9f-2c5c-4f6b-80bf-98179443b9e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090328 Aug 05 05:37:26.461423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 815/1610] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:26.489231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:26.489840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:26.496478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:26.496956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:26.497380 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:26.498056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:26.498556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:26.498928 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:26.632037 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:26.640843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cfd03175-e526-4c33-801d-edc6f2a218ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.155524 Aug 05 05:37:26.641390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 796/1611] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:26 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:27.481866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:27.482513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:27.491845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:27.492563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:27.493205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:27.494312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:27.494777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:27.495206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:27.560446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:27.573372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eb0f4cfd-76e7-44b6-94f1-4c1330ec8384 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095225 Aug 05 05:37:27.574060 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 816/1612] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:27.669894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:27.670904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:27.681821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:27.682305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:27.682720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:27.683421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:27.683909 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:27.684329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:27.830372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:27.842882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2a36a775-ad00-4565-b3c8-b1fee6777c6f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.179101 Aug 05 05:37:27.843664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 797/1613] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:27 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:28.597721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:28.598737 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:28.607378 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:28.607878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:28.608314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:28.609000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:28.609460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:28.609871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:28.669864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:28.677932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1d4d8dc0-8d20-4f4f-9c2a-18554c5dc811 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.086619 Aug 05 05:37:28.678499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 817/1614] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:28 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:28.871588 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:28.872534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:28.883567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:28.884722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:28.885199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:28.886112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:28.886605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:28.887082 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:29.023172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:29.035333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6c991bcd-bba0-4722-864f-55408c6682dc tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169972 Aug 05 05:37:29.036173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 798/1615] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:28 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:29.701014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:29.701688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:29.708518 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:29.708999 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:29.709429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:29.710114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:29.710559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:29.710979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:29.773415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:29.781561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dc42fcf3-dd9f-41c7-9af7-e9963d6a90e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.085222 Aug 05 05:37:29.782162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 818/1616] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:30.057029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:30.057644 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:30.064580 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:30.065063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:30.065492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:30.066179 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:30.066626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:30.067045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:30.208851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:30.212323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:30.218005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-20b1a65f-dc0d-4731-81c4-5de7cabcc95c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165516 Aug 05 05:37:30.218582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 799/1617] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:30 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:30.806350 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:30.807270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:30.814669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:30.815155 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:30.815592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:30.816321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:30.816768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:30.817192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:30.879081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:30.882482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:30.887863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c88fe43a-8888-4bfb-be09-462fcffda4a1 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088158 Aug 05 05:37:30.888449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 819/1618] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:31.243227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:31.244408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:31.255475 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:31.256382 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:31.257101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:31.258231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:31.258978 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:31.259680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:31.395548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:31.403597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4900c59c-2bde-4489-a6ef-347fd48b3214 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167041 Aug 05 05:37:31.404345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 800/1619] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:31 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:31.910233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:31.910828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:31.918171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:31.918646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:31.919081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:31.919795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:31.920275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:31.920702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:31.988245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:31.996420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a28e559c-4748-4b59-881e-55cdc8e86021 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090145 Aug 05 05:37:31.997033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 820/1620] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:32.428652 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:32.429724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:32.438245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:32.438717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:32.439144 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:32.439859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:32.440303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:32.440716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:32.585110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:32.593698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a8e47722-cfce-4f23-9e1e-a7872aa9e0ec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171810 Aug 05 05:37:32.594265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 801/1621] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:32 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:33.022174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:33.023188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:33.031813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:33.032329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:33.032768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:33.033461 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:33.033914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:33.034330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:33.095043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:33.103202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c12cf436-09fa-4364-b19f-e9d71a4ab1f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088107 Aug 05 05:37:33.103794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 821/1622] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:33.614731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:33.615347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:33.622197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:33.622688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:33.623120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:33.623810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:33.624291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:33.624716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:33.758776 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:33.771547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5561ad4c-1871-48d6-a6b5-f652df2d0c8b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160550 Aug 05 05:37:33.772515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 802/1623] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:33 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:34.128190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:34.129272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:34.139014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:34.139496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:34.139972 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:34.140659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:34.141109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:34.141529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:34.211885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:34.219910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-164be524-e64e-4077-8b63-de8df52de68c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098513 Aug 05 05:37:34.220506 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 822/1624] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:34.796881 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:34.797872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:34.809048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:34.809526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:34.809956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:34.810631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:34.811084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:34.811491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:34.939255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:34.947581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0cdb4acf-dd20-445c-a11a-9238dbd3dc39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157330 Aug 05 05:37:34.948206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 803/1625] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:34 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:35.244827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:35.245837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:35.252977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:35.253459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:35.253892 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:35.254579 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:35.255054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:35.255475 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:35.325210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:35.333680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-54d68a6b-587e-41d1-953d-a22e2eca9f8a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095562 Aug 05 05:37:35.334242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 823/1626] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:35.968770 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:35.969362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:35.975941 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:35.976440 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:35.976855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:35.977546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:35.977979 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:35.978396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:36.113607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:36.125141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-05d98d27-eb30-4ff5-8a12-08443bf92ad5 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159931 Aug 05 05:37:36.125691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 804/1627] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:35 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:36.359182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:36.360258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:36.371066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:36.371728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:36.372205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:36.372891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:36.373338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:36.373757 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:36.711649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:36.719963 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ec467573-5a6f-4f0e-a2fb-6915cf5ec658 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.367250 Aug 05 05:37:36.720539 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 824/1628] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:37.146854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:37.147467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:37.154423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:37.154922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:37.155520 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:37.156260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:37.156694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:37.157105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:37.353841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:37.363172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-deb6b869-1e30-431e-9330-33869757527f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.220632 Aug 05 05:37:37.363753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 805/1629] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:37 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:37.741413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:37.742027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:37.744480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:37.750143 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:37.750617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:37.751049 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:37.751728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:37.752199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:37.752616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:37.821931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:37.830139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b501cf74-04ce-4fc2-bd54-4b4a797cd52b tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092906 Aug 05 05:37:37.830684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 825/1630] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:38.388843 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:38.389668 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:38.400854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:38.401712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:38.402536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:38.403246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:38.403695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:38.404139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:38.535787 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:38.547342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-81d42106-28ce-4743-9d19-531e07b13a85 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164856 Aug 05 05:37:38.548162 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 806/1631] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:38 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:38.855107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:38.856250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:38.864714 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:38.865355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:38.865921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:38.866823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:38.867424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:38.868014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:38.934627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:38.943144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2cfec77e-dcb8-4915-9d92-ae48daf468e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094622 Aug 05 05:37:38.943705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 826/1632] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:38 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:39.576324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:39.577086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:39.583603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:39.584127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:39.584569 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:39.585276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:39.585712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:39.586132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:39.727113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:39.735284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c4488cd6-2202-4c7f-80e1-4fddd48696ba tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.165690 Aug 05 05:37:39.735884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 807/1633] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:39 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:39.967597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:39.968391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:39.976853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:39.977460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:39.978003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:39.978859 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:39.979416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:39.979983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:40.048507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:40.056679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c20cf054-eb2b-4d9c-b5a5-75302e2863cd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095402 Aug 05 05:37:40.057258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 827/1634] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:39 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:40.760563 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:40.761555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:40.773094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:40.773908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:40.774635 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:40.775833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:40.776582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:40.777292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:40.912966 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:40.921616 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b71c4000-398e-4c55-9114-bf393598a429 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167626 Aug 05 05:37:40.922263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 808/1635] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:40 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:41.078847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:41.079556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:41.087094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:41.087639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:41.089962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:41.090789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:41.091300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:41.091801 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:41.155343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:41.163598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-047d3b3b-de4c-4ef2-a94f-1af6aca1438e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089298 Aug 05 05:37:41.164189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 828/1636] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:41 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:41.946750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:41.947728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:41.955340 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:41.955852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:41.956270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:41.956945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:41.957387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:41.957801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:42.086052 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:42.094653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c36ff322-b9fe-4122-bf2e-81d27177e177 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.154365 Aug 05 05:37:42.095224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 809/1637] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:41 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:42.186763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:42.187392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:42.194258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:42.194742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:42.195174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:42.195935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:42.196388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:42.196870 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:42.257099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:42.265512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7839077f-7253-43a8-8d44-c805663823e2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.083710 Aug 05 05:37:42.266072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 829/1638] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:42 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:43.120141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:43.121123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:43.128308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:43.128790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:43.129217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:43.129912 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:43.130352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:43.130769 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:43.271799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:43.280530 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2aa0cb85-9a23-49f1-b230-34a856976d86 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166995 Aug 05 05:37:43.281097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 810/1639] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:43 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:43.286652 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:43.287345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:43.293971 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:43.294437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:43.294921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:43.295604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:43.296071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:43.296484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:43.360841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:43.372584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-44f9fdc7-dc16-4d2f-b852-0bd9cd2a9779 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089435 Aug 05 05:37:43.373304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 830/1640] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:43 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:44.304618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:44.305203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:44.313485 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:44.313974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:44.314407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:44.315093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:44.315538 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:44.316023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:44.399224 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:44.399864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:44.406696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:44.407354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:44.407966 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:44.408692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:44.409145 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:44.409528 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:44.465404 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:44.473806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0e2642fb-455f-45a6-9da4-eaebc96c7c07 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175242 Aug 05 05:37:44.474347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 811/1641] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:44 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:44.481171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:44.489771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4df72a1f-cea8-49a2-a07c-4cc214e27739 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094545 Aug 05 05:37:44.490322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 831/1642] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:44 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:45.499096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:45.500149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:45.504035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=52 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:45.513714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:45.514517 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:45.514819 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:45.515521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:45.515721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:45.516419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:45.516868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:45.517302 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:45.523248 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:45.523727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:45.524185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:45.524850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:45.525295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:45.525706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:45.616454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:45.626723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-376a9f9d-c2e0-45cf-9a7f-3a711fd0a9ed tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.118231 Aug 05 05:37:45.627423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 832/1643] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:45 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:45.685428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:45.694743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-96967a75-35d7-4643-ac46-b76743ba305a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.202296 Aug 05 05:37:45.695290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 812/1644] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:45 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:46.652367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:46.652962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:46.660950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:46.661429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:46.661855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:46.662570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:46.663014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:46.663430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:46.716971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:46.717599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:46.724587 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:46.725101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:46.725720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:46.726188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:46.726631 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:46.727039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:46.727960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:46.736607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9fa53e95-092d-4c89-9f62-5e6cbf190c9e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090647 Aug 05 05:37:46.737179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 833/1645] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:46 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:46.857681 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:46.866173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4cb27aa3-57dc-48e6-8c23-818106891900 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.153084 Aug 05 05:37:46.866788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 813/1646] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:46 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:47.762732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:47.763736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:47.771934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:47.772412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:47.772837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:47.773522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:47.773962 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:47.774379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:47.835913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:47.844356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a35cac99-c4bc-462e-8c6b-ad30c2aab86a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088344 Aug 05 05:37:47.844923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 834/1647] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:47 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:47.887483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:47.888110 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:47.895446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:47.895977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:47.896411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:47.897117 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:47.897545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:47.897963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:48.044083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:48.052402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-2c193988-7f3b-4e14-8b20-7dc02c076b22 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168823 Aug 05 05:37:48.052971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 814/1648] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:47 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:48.869630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:48.870627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:48.879237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:48.879873 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:48.880462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:48.880965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:48.881474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:48.881913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:48.944019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:48.952496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4eb22ad1-255e-4b40-8cb5-5aa85f94ce4e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089535 Aug 05 05:37:48.953067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 835/1649] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:48 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:49.078659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:49.079281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:49.086216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:49.086705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:49.087137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:49.087841 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:49.088419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:49.088845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:49.219087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:49.229685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9e700275-6f97-41b1-8e45-9f20aadb8954 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.157405 Aug 05 05:37:49.230550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 815/1650] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:49 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:49.983680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:49.984827 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:49.993180 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:49.993779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:49.994363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:49.995164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:49.995720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:49.996279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:50.018731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:50.070338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:50.078928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8bffd5db-668b-4800-b941-5ce11ffab003 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101781 Aug 05 05:37:50.079497 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 836/1651] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:49 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:50.255020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:50.255932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:50.266830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:50.268093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:50.268810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:50.269931 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:50.270662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:50.271351 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:50.293504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:37:50.410955 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:50.422595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e48478b6-c1de-4d56-a448-600f4fc074f1 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174213 Aug 05 05:37:50.423352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 816/1652] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:50 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:51.100734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:51.101290 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:51.108592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:51.109051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:51.109572 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:51.110329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:51.110780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:51.111220 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:51.173113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:51.181429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a1e457e9-347b-4895-9bcc-bd01945a4d12 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084790 Aug 05 05:37:51.181989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 837/1653] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:51 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:51.453457 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:51.454195 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:51.462465 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:51.463061 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:51.463590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:51.464472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:51.465019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:51.465536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:51.873860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:51.882947 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4832a367-43b5-4b65-ad7f-d21a675abbbf tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.436167 Aug 05 05:37:51.883526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 817/1654] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:51 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:52.207035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:52.208117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:52.219222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:52.220086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:52.220802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:52.221949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:52.222687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:52.223388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:52.290705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:52.300327 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-172128e6-d3e5-4908-a5b5-d84fede43516 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099964 Aug 05 05:37:52.300887 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 838/1655] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:52 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:52.908897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:52.909976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:52.920830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:52.921625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:52.922339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:52.923202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:52.923649 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:52.924093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:53.065565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:53.073872 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f89c69e9-90d7-448d-ad0b-61dc399b02d3 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171628 Aug 05 05:37:53.074429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 818/1656] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:52 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:53.324909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:53.325796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:53.336799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:53.337667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:53.338373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:53.339543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:53.340332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:53.341030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:53.407392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:53.415969 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6f2e8f97-7ecb-4828-b001-8a35e4fe939a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.097764 Aug 05 05:37:53.416535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 839/1657] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:53 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:54.098892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:54.099744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:54.110574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:54.111374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:54.112152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:54.113277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:54.114035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:54.114716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:54.245518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:54.254459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-391b5d0f-cceb-469c-a700-417be07c5484 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162299 Aug 05 05:37:54.255042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 819/1658] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:54 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:54.440979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:54.442826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:54.453631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:54.454416 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:54.455078 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:54.455790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:54.456235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:54.456651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:54.517954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:54.526580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-052151ab-bffe-486a-85c1-c74db5558116 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.092121 Aug 05 05:37:54.527152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 840/1659] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:54 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:55.280425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:55.281252 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:55.292266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:55.293073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:55.293781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:55.294935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:55.295676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:55.296420 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:55.427858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:55.436173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ef579c06-4ac1-4554-a824-ae71a4175632 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.162530 Aug 05 05:37:55.436741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 820/1660] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:55 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:55.551065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:55.551967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:55.562835 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:55.563630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:55.564412 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:55.565296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:55.565767 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:55.566189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:55.626750 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:55.635012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-460bd33c-de91-4734-ac1e-efd2a4027952 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090865 Aug 05 05:37:55.635558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 841/1661] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:55 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:56.460101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:56.461218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:56.470575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:56.471197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:56.471632 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:56.472364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:56.472816 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:56.473236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:56.608723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:56.617186 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bb2c8bac-b9d9-4cad-9d3b-7f0a272de641 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163587 Aug 05 05:37:56.617757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 821/1662] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:56 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:56.656688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:56.657267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:56.664019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:56.664501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:56.664933 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:56.665627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:56.666074 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:56.666635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:56.732740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:56.742507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-442b50fe-e9fd-48f9-840c-4e53a0b011f8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089692 Aug 05 05:37:56.743061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 842/1663] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:56 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:37:57.643227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:57.644235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:57.654971 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:57.655794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:57.656543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:57.657672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:57.658497 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:57.658953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:57.762717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:57.763441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:57.770660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:57.771150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:57.771581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:57.772316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:57.772766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:57.773195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:57.791506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:57.802840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-053b58d5-7bf3-407c-ae2e-ab0f22c73bc6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166669 Aug 05 05:37:57.803399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 822/1664] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:57 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:57.837404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:57.845686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f5f903c5-b158-4ad5-86a9-35763f903f88 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.086892 Aug 05 05:37:57.846239 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 843/1665] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:57 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:58.828546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:58.829506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:58.837889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:58.838415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:58.838886 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:58.839636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:58.840169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:58.840633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:58.867352 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:58.867929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:37:58.874620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:58.875195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:58.875877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:58.876907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:37:58.877366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:37:58.877785 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:37:58.960769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:58.969191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1c833da0-4ae0-485f-b49c-020dcffaa43e tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105929 Aug 05 05:37:58.970328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 844/1666] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:58 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:59.001035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:37:59.009654 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d70ad484-3227-429d-86bd-5e21b6fa1aec tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.187611 Aug 05 05:37:59.010230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 823/1667] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:58 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:37:59.995043 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:37:59.996181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:00.006158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:00.006642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:00.007070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:00.007794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:00.008280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:00.008703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:00.030960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:00.031553 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:00.038488 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:00.038984 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:00.039419 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:00.040147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:00.040601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:00.041020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:00.071024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:00.079282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e20ab901-f644-4b63-a80c-9122c3641de9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090810 Aug 05 05:38:00.079891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 845/1668] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:37:59 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:00.188207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:00.196755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e2e44127-cb6a-4ccb-9760-1adfc7427625 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169926 Aug 05 05:38:00.197323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 824/1669] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:00 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:01.102278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:01.102936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:01.112166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:01.113000 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:01.113456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:01.114135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:01.114846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:01.115487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:01.177569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:01.186035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d1c5dfc0-2d4e-48ca-be5d-55a18c9c00c3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089063 Aug 05 05:38:01.186615 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 846/1670] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:01 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:01.219648 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:01.220312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:01.228757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:01.229225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:01.229651 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:01.230332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:01.230771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:01.231181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:01.364792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:01.372901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0b0e9d1b-9f11-440d-92e9-6bdf79d9dd2b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.159223 Aug 05 05:38:01.373504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 825/1671] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:01 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:02.211105 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:02.212116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:02.222881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:02.223367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:02.223795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:02.224520 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:02.224970 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:02.225392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:02.297986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:02.310324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fcb4398e-869e-4d00-97bd-852bed9f8cd6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105446 Aug 05 05:38:02.311040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 847/1672] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:02.398435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:02.399442 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:02.410270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:02.410753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:02.411180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:02.411915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:02.412368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:02.412778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:02.549837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:02.558236 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f4c0d634-0098-4e42-90dd-a84c9a91965e tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.166749 Aug 05 05:38:02.558819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 826/1673] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:02 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:03.337511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:03.338358 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:03.349209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:03.349988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:03.350704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:03.351850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:03.352699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:03.353402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:03.420080 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:03.428931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-fcb10bc1-d02f-48c5-ae5e-dae27bfac905 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098148 Aug 05 05:38:03.429508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 848/1674] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:03 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:03.582663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:03.583665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:03.594657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:03.595367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:03.596156 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:03.597486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:03.597938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:03.598366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:03.744083 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:03.752547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9fc64049-29a5-4052-9095-2c79c92430e0 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.176510 Aug 05 05:38:03.753107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 827/1675] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:03 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:04.454381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:04.455551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:04.466465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:04.467260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:04.468034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:04.469166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:04.469908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:04.470611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:04.544950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:04.553430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c5cd9846-aa22-44c6-8bd1-0fe1da444a25 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.105979 Aug 05 05:38:04.554014 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 849/1676] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:04 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:04.778522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:04.779451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:04.790315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:04.791113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:04.791837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:04.792987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:04.793718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:04.794407 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:04.924838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:04.933214 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-68905dc2-1c85-4c9a-aa74-c3aead68ef5f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.161299 Aug 05 05:38:04.933757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 828/1677] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:04 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:05.578806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:05.579805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:05.587398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:05.587909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:05.588342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:05.589036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:05.589486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:05.589908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:05.650414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:05.658584 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-1b033052-5f70-4304-bea1-b4fbdd892018 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.086393 Aug 05 05:38:05.659154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 850/1678] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:05 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:05.958259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:05.959105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:05.969774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:05.970518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:05.971290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:05.972515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:05.972962 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:05.973379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:06.110734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:06.122727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-87fb697c-06da-4b05-968d-de069b0d8b77 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.170994 Aug 05 05:38:06.123461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 829/1679] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:05 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:06.689822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:06.690885 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:06.698258 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:06.698740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:06.699174 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:06.699918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:06.700373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:06.700806 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:06.769878 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:06.778025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9c2af23b-1a85-458d-aa17-30ba372015aa tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094852 Aug 05 05:38:06.778599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 851/1680] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:06 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:07.151067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:07.152139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:07.162986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:07.163812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:07.164548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:07.165676 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:07.166418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:07.167113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:07.309555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:07.318041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6ac897d5-e393-4d17-8cac-ef47b0d2bedd tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.173536 Aug 05 05:38:07.318611 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 830/1681] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:07 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:07.803311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:07.804300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:07.808182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:07.817338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:07.818117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:07.818840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:07.819992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:07.820744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:07.821435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:07.889319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:07.898158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-292aeab5-8ec9-4c91-80f1-a848b396a1b7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101469 Aug 05 05:38:07.898723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 852/1682] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:07 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:08.342603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:08.343550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:08.352702 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:08.353190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:08.353619 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:08.354309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:08.354761 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:08.355169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:08.644366 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:08.652615 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fe3a9b2a-7abb-466a-ab38-8806786ece39 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.316512 Aug 05 05:38:08.653151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 831/1683] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:08 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:08.921054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:08.921828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:08.930551 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:08.931217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:08.931752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:08.932720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:08.933312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:08.934121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:08.939100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:08.998641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:09.006967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a40ac986-f2fe-4cf2-b05f-cd77aaad8112 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.091243 Aug 05 05:38:09.007512 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 853/1684] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:08 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:09.681137 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:09.682182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:09.693290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:09.694088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:09.694830 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:09.695519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:09.696028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:09.696444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:09.829509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:09.837642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c227a5c2-78a4-4e6d-8a32-7e29d3bfcd57 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164784 Aug 05 05:38:09.838207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 832/1685] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:09 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:10.029758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:10.030369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:10.037232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:10.037711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:10.038145 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:10.038820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:10.039265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:10.039680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:10.105382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:10.113744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bf49a10f-0233-4420-abed-7d771dbf7852 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087949 Aug 05 05:38:10.114303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 854/1686] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:10 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:10.861551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:10.862359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:10.870298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:10.870783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:10.871208 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:10.871927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:10.872363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:10.872773 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:10.876809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:11.015393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:11.024389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-547a8464-668b-40cf-ad95-160a0c22e1f9 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167992 Aug 05 05:38:11.024987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 833/1687] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:10 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:11.135118 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:11.135669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:11.142915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:11.143388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:11.143847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:11.144530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:11.145015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:11.145430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:11.206605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:11.214862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3ce03a25-7090-4c25-baeb-c6b935242134 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.083898 Aug 05 05:38:11.215424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 855/1688] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:11 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:12.046759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:12.047472 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:12.055694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:12.056329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:12.056852 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:12.057667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:12.058205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:12.058711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:12.202151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:12.213247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fa94af68-703c-4349-8646-f66c54c5ae7a tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171249 Aug 05 05:38:12.213803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 834/1689] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:12 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:12.235882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:12.236446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:12.243458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:12.243968 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:12.244397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:12.245073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:12.245515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:12.245929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:12.308632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:12.316709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8d094d4f-8a15-4835-86cc-3293d49b9c64 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084770 Aug 05 05:38:12.317279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 856/1690] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:12 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:38:13.238091 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:13.239093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:13.250461 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:13.251245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:13.252004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:13.253221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:13.253865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:13.254561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:13.337890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:13.338508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:13.345301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:13.345789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:13.346223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:13.346919 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:13.347367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:13.347796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:13.403863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:13.412251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-611dba77-0416-4d10-aaed-16b6c115b937 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.180719 Aug 05 05:38:13.413053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 835/1691] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:13 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:13.419537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:13.427736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-24ee103e-5762-46aa-a520-3f9fab8949de tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093806 Aug 05 05:38:13.428303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 857/1692] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:13 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:14.437715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:14.438680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:14.449627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:14.450491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:14.451121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:14.452368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:14.453136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:14.453823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:14.458733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:14.459736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:14.466787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:14.467275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:14.467712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:14.468457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:14.468905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:14.469382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:14.549853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:14.559554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-624d09de-185c-4099-a5fa-97ac1ac7a7f2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.107182 Aug 05 05:38:14.560508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 858/1693] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:14 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:14.614748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:14.623046 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-44b0f905-3a32-4dc7-a409-bcc567997e42 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.191798 Aug 05 05:38:14.623598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 836/1694] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:14 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:15.581182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:15.581820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:15.588929 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:15.589406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:15.589842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:15.590533 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:15.590977 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:15.591401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:15.644616 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:15.645199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:15.647534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=50 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:15.654084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:15.654084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:15.654345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:15.655042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:15.655491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:15.655936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:15.656085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:15.664318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ff70522f-0ee7-4533-8a9d-4baead846cdd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087102 Aug 05 05:38:15.664917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 859/1695] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:15 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:15.785813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:15.794235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-24c3e3ba-5eb1-40a3-a29d-73d34ca6072c tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.153917 Aug 05 05:38:15.794788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 837/1696] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:15 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:16.688918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:16.689973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:16.700858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:16.701550 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:16.702259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:16.703383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:16.704187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:16.704881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:16.772699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:16.780905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aa3989e8-05d7-44c0-b8e0-00f37da0c01c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.098673 Aug 05 05:38:16.781463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 860/1697] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:16 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:16.818070 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:16.818746 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:16.828574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:16.829210 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:16.829825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:16.830797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:16.831423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:16.832100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:16.970869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:16.979395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5833b759-2abc-4972-ba70-bec5b015e759 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167805 Aug 05 05:38:16.980170 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 838/1698] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:16 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:17.806036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:17.806988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:17.817907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:17.818708 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:17.819476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:17.820235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:17.820679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:17.821091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:17.891800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:17.900555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c3b6e70e-5d7b-405f-aa61-ae601300e2b6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.101065 Aug 05 05:38:17.901128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 861/1699] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:17 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:18.005002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:18.006019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:18.013552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:18.014044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:18.014474 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:18.015301 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:18.015751 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:18.016217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:18.154109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:18.166698 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-79752a33-62df-4b79-a88c-d8df7a9a4c1d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168116 Aug 05 05:38:18.167412 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 839/1700] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:17 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:18.921789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:18.922400 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:18.929431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:18.929909 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:18.930336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:18.931020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:18.931460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:18.931942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:18.997012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:19.005373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c1e51e13-0323-49d2-839f-89aa7ffbabaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087547 Aug 05 05:38:19.005932 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 862/1701] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:18 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:19.196766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:19.198206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:19.209057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:19.209889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:19.210597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:19.211292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:19.211733 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:19.212188 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:19.351087 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:19.359671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d6534690-3781-4892-88d6-32c0c5be2a50 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.169854 Aug 05 05:38:19.360277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 840/1702] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:19 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:20.027863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:20.028624 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:20.036683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:20.037233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:20.037732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:20.038596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:20.039041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:20.039457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:20.105395 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:20.117036 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-aeeb859b-4433-4e7e-b9b6-1acd03bf03d6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093494 Aug 05 05:38:20.117726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 863/1703] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:20 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:20.392716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:20.393625 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:20.402230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:20.402712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:20.403136 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:20.403853 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:20.404294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:20.404707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:20.535968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:20.544244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-47ee2050-06f9-4740-9001-91288c537581 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158510 Aug 05 05:38:20.544783 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 841/1704] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:20 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:21.143432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:21.144087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:21.150936 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:21.151417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:21.151879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:21.152556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:21.152998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:21.153413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:21.223544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:21.232153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-18ce630a-7e69-45cd-8423-61b10d260992 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.093027 Aug 05 05:38:21.232723 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 864/1705] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:21 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:21.419255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:38:21.419919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:38:21.548301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:38:21.548577 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:38:21.571744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:21.572394 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:21.579244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:21.579728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:21.580190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:21.580877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:21.581323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:21.581743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:21.715311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:21.724475 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3db1823f-6c9f-45a1-acca-59a2fced1201 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158006 Aug 05 05:38:21.725044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 842/1706] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:21 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:22.257321 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:22.257898 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:22.265558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:22.266127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:22.266602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:22.267719 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:22.268265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:22.268731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:22.332054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:22.340425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d73a2ae9-1f89-4782-8c66-e00726afb445 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089856 Aug 05 05:38:22.340979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 865/1707] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:22 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:22.747372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:22.748248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:22.758213 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:22.758846 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:22.759436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:22.760381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:22.760975 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:22.761529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:22.906699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:22.919977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6820378-a4be-4d69-86f8-6cdf06f8b400 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.177528 Aug 05 05:38:22.920641 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 843/1708] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:22 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:23.365671 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:23.366510 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:23.373423 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:23.373908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:23.374342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:23.375040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:23.375483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:23.375943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:23.440742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:23.449162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-174a2801-9f42-4b61-a7e0-82ed4029d11d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090152 Aug 05 05:38:23.449696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 866/1709] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:23 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:23.945543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:23.946238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:23.954903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:23.955499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:23.956080 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:23.956964 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:23.957516 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:23.958034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:24.095594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:24.104058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ec70f296-eeea-44fe-bedb-6c27a66f1f18 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.164927 Aug 05 05:38:24.104636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 844/1710] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:23 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:24.477280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:24.477866 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:24.484727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:24.485208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:24.485634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:24.486314 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:24.486760 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:24.487173 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:24.553459 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:24.562456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-44372288-9fc8-4b77-9f00-932026e651e9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.090842 Aug 05 05:38:24.563034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 867/1711] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:24 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:25.125595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:25.126206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:25.136277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:25.137072 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:25.137788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:25.138916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:25.139658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:25.140406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:25.276332 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:25.284786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-178d7ec8-42bb-495f-a0b0-10173e8cfcbb tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163179 Aug 05 05:38:25.285353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 845/1712] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:25 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:25.736003 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:25.736614 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:25.743004 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:25.743480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:25.743950 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:25.744626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:25.745069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:25.745451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:25.816273 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:25.824687 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f8de15bd-116f-4c97-8b10-3f8dde8f5179 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.243022 Aug 05 05:38:25.825243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 868/1713] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:25 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:26.310145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:26.311016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:26.321823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:26.322305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:26.322738 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:26.323431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:26.323918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:26.324342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:26.458198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:26.466345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-74529d98-1a1e-4466-a410-97e8d20e009d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.163029 Aug 05 05:38:26.466921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 846/1714] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:26 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:26.850140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:26.851186 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:26.860159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:26.860807 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:26.861375 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:26.862293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:26.862881 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:26.863431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:26.934027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:26.937418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=100 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:26.942745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9eb4e708-61ec-4ecc-8d6e-855ec0651950 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099295 Aug 05 05:38:26.943337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 869/1715] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:26 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:27.489016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:27.489620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:27.496915 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:27.497433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:27.497889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:27.498636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:27.499111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:27.499558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:27.648515 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:27.659085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1a21e2ad-bbe3-4842-875f-bbcf309b135b tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.175883 Aug 05 05:38:27.659813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 847/1716] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:27 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:27.968871 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:27.969855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:27.980854 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:27.981649 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:27.982369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:27.983500 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:27.984284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:27.985005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:28.049056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:28.057794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-12c5694f-8e3e-4928-9fe2-6d1d57d9f0a6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.095835 Aug 05 05:38:28.058333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 870/1717] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:27 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:28.685124 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:28.686100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:28.697104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:28.697937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:28.698657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:28.699837 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:28.700574 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:28.701275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:28.837823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:28.846376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c07dcf83-80bd-4baf-9682-b0d98d6738e8 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.168121 Aug 05 05:38:28.846940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 848/1718] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:28 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:29.082704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:29.083705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:29.094740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:29.095537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:29.096311 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:29.097448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:29.098275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:29.098845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:29.162451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:29.170825 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0cb08365-6e6a-406c-b553-5d5704d15dbe tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.094665 Aug 05 05:38:29.171403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 871/1719] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:29 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:29.867874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:29.868429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:29.876679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:29.877467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:29.878176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:29.879292 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:29.880148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:29.880838 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:30.015593 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:30.019455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=100 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:30.024778 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d0738fe0-e1e2-4029-b3be-4a787516868f tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.160955 Aug 05 05:38:30.025347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 849/1720] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:29 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:30.197084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:30.198144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:30.208467 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:30.210609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:30.210609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:30.211023 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:30.211597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:30.212278 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:30.285448 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:30.293883 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0811d59f-5124-4a56-bbd1-50b8c18b11e6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.103558 Aug 05 05:38:30.294446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 872/1721] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:30 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:31.045572 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:31.046161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:31.053079 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:31.053555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:31.053982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:31.054659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:31.055101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:31.055503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:31.189094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:31.197364 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ae9d3356-6818-48c5-9ff3-8d4c7e5a75b6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.156093 Aug 05 05:38:31.197948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 850/1722] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:31 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:31.318869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:31.319702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:31.327279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:31.327786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:31.328227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:31.328915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:31.329365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:31.329786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:31.391586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:31.400426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a87df293-6424-4d76-ae90-517882d3a1e7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088216 Aug 05 05:38:31.400994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 873/1723] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:31 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:32.222921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:32.223901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:32.232331 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:32.232808 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:32.233237 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:32.233913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:32.234355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:32.234766 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:32.375480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:32.384225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-50715ab6-94bc-451b-aa14-459209130e2d tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.167753 Aug 05 05:38:32.384770 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 851/1724] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:32 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:32.422071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:32.422688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:32.429333 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:32.429822 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:32.430254 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:32.431038 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:32.431489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:32.431991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:32.494679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:32.503048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b0982e18-64e1-45f7-a48f-9e75952d4cfd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.084869 Aug 05 05:38:32.503589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 874/1725] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:32 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:33.409960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:33.411008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:33.421897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:33.422695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:33.423409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:33.424598 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:33.425365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:33.426057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:33.524092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:33.524669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:33.531136 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:33.531616 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:33.532088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:33.532802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:33.533217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:33.533633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:33.566142 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:33.575049 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8b5c88eb-826f-4d65-888b-73d47bceeeab tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.171663 Aug 05 05:38:33.575628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 852/1726] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:33 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:33.600987 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:33.609728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2e0b0f1e-9d53-4ddb-87ac-093d0cc932f5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.089525 Aug 05 05:38:33.610323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 875/1727] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:33 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:34.595678 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:34.596334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:34.602763 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:34.603245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:34.603685 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:34.604405 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:34.604960 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:34.605377 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:34.630858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:34.631425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:34.638604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:34.639084 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:34.639514 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:34.640238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:34.640680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:34.641096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:34.720503 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:34.728904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-16f49df0-58ac-411f-b436-0ccb7b28bdaf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.102097 Aug 05 05:38:34.729474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 876/1728] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:34 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:34.757699 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:34.765761 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0ee681a1-3fa8-4338-9b8d-36df2471dbda tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.174125 Aug 05 05:38:34.766355 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 853/1729] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:34 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:35.752104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:35.752907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:35.761362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:35.761847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:35.762287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:35.762992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:35.763445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:35.763908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:35.786891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:35.787511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:35.794499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:35.794985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:35.795424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:35.796151 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:35.796606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:35.797031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:35.825558 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:35.833796 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-05d2e4da-594f-4a02-996f-5a281b77496a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.087058 Aug 05 05:38:35.834634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 877/1730] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:35 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:35.932896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:35.941415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d5874a53-441b-46b4-9e67-868296bed230 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.158422 Aug 05 05:38:35.941991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 854/1731] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:35 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:36.858319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:36.859297 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:36.869626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:36.870107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:36.870538 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:36.871235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:36.871683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:36.872135 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:36.942995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:36.951569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d70381b1-5f47-462d-b7e5-888c9381244c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.099874 Aug 05 05:38:36.952183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 878/1732] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:36 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:36.964314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:36.965023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] [instance: b5caff55-2233-4dbd-8296-3b018d176171] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:36.971575 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:36.972217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:36.972643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:36.973319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:36.973759 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:36.974167 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:37.147510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06de5afa7d2d4d3aa0c1378ceeb5c4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af046d32c704d8bb13b821da2b8338a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:37.156952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c04b16c9-3cb3-4fc1-b576-6b84cf9de8a6 tempest-VolumesSnapshotTestJSON-1008016229 tempest-VolumesSnapshotTestJSON-1008016229-project] 10.222.0.30 "GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171" status: 200 len: 1561 microversion: 2.1 time: 0.196568 Aug 05 05:38:37.157513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 855/1733] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:36 2022] GET /compute/v2.1/servers/b5caff55-2233-4dbd-8296-3b018d176171 => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:37.975701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:37.976678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:37.978957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=54 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:37.984639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:37.985121 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:37.985561 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:37.986256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:37.986704 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:37.987127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:38.049600 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:38.057888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-663992a3-ebe8-4c98-8871-d1f8ee57736c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 200 len: 1371 microversion: 2.1 time: 0.088696 Aug 05 05:38:38.058451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 879/1734] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:37 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:38.084636 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3841c1bb-48fe-461b-8741-a4da9de674a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '.version_select at 0x7fdc9dcd79d0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:38.110368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3841c1bb-48fe-461b-8741-a4da9de674a7 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986966782" status: 202 len: 0 microversion: 2.1 time: 0.029718 Aug 05 05:38:38.110950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 856/1735] 10.222.0.30 () {58 vars in 1218 bytes} [Fri Aug 5 05:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986966782 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:38:38.945954 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-931ae36d-b860-4be2-842c-0629fec10734 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: .version_select at 0x7fdc9dccfa60>, body: {"keypair": {"name": "tempest-keypair-1723942568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQx8JzYeGnKOf3MlLMUxOoE+S+zdb6DMrtZxLNCQhA7q6y0dFURRHmWEyh8gF7TjRlrVogpHRmCTg1B8H9vH8rw3SnTpa1dd6PUVSU+xpupW7Rjd3H83l368KOTb9YESQ=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:38:38.962052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-931ae36d-b860-4be2-842c-0629fec10734 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:38:38.966424 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-931ae36d-b860-4be2-842c-0629fec10734 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:38:38.994524 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-931ae36d-b860-4be2-842c-0629fec10734 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052590 Aug 05 05:38:39.000805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 880/1736] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:38:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:38:39.142392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:38:39.142612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:38:40.261500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382714715", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dfb9760-7f7c-4d72-90dd-3ced7593c930"}], "security_groups": [{"name": "tempest-securitygroup--927610293"}], "key_name": "tempest-keypair-1723942568", "user_data": "}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:38:40.370081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] validate_networks() for [('8dfb9760-7f7c-4d72-90dd-3ced7593c930', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:38:40.812034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:38:40.812456 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:38:40.812958 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:38:40.813383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:38:40.813786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:38:40.825710 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:40.826348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:40.826985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:40.828155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:40.828826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:40.829421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:40.849007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:38:40.853042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:38:40.864408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:38:40.866694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:38:40.920026 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6614fddd-1286-49e8-94f0-10d271fd0080 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663524 Aug 05 05:38:40.920661 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 857/1737] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:38:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:38:40.932465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d3fb7572-2866-468a-ac89-a308604255db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:40.933171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d3fb7572-2866-468a-ac89-a308604255db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:40.988817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d3fb7572-2866-468a-ac89-a308604255db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:40.997768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d3fb7572-2866-468a-ac89-a308604255db tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1242 microversion: 2.1 time: 0.067904 Aug 05 05:38:40.997768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 881/1738] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:40 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:41.963418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:38:41.964086 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:38:42.017071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:42.018014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:42.024338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:42.024820 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:42.025234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:42.026033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:42.026483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:42.026900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:42.096805 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:42.105883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5c655f12-15d6-4fb0-aa37-08ead62605cb tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1302 microversion: 2.1 time: 0.093645 Aug 05 05:38:42.106812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 858/1739] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:42 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:43.126876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:43.127491 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:43.134460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:43.134953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:43.135478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:43.136198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:43.136685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:43.137066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:43.319555 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:43.327573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-0f6599bb-4fac-4e9e-8a2f-d4afe6bd483f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1367 microversion: 2.1 time: 0.204608 Aug 05 05:38:43.328160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 882/1740] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:43 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:43.888546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-416b95b7-8138-4887-ab7c-9a927d11e4ec req-7dcd11bf-7639-4d5a-bf6d-823d275e1642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50a3344-e2e5-472d-ad37-8256ef7a8919", "tag": "c4a5b796-7b08-4ee3-b764-24bb8a0a7b79"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:38:43.898508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-416b95b7-8138-4887-ab7c-9a927d11e4ec req-7dcd11bf-7639-4d5a-bf6d-823d275e1642 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:43.898968 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-416b95b7-8138-4887-ab7c-9a927d11e4ec req-7dcd11bf-7639-4d5a-bf6d-823d275e1642 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:43.899573 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-416b95b7-8138-4887-ab7c-9a927d11e4ec req-7dcd11bf-7639-4d5a-bf6d-823d275e1642 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:43.910694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-416b95b7-8138-4887-ab7c-9a927d11e4ec req-7dcd11bf-7639-4d5a-bf6d-823d275e1642 service nova] Creating event network-changed:c4a5b796-7b08-4ee3-b764-24bb8a0a7b79 for instance c50a3344-e2e5-472d-ad37-8256ef7a8919 on hv-cinder-81558 Aug 05 05:38:43.917157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-416b95b7-8138-4887-ab7c-9a927d11e4ec req-7dcd11bf-7639-4d5a-bf6d-823d275e1642 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103665 Aug 05 05:38:43.917755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 859/1741] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:38:44.348993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:44.349585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:44.356576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:44.357056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:44.357484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:44.358164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:44.358607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:44.359027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:44.494123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:44.502102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-639a882c-6676-481f-ad6b-5cd632d38663 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1367 microversion: 2.1 time: 0.157111 Aug 05 05:38:44.502677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 883/1742] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:44 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:45.525120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:45.525734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:45.532409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:45.532892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:45.533321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:45.534101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:45.534548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:45.534965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:45.670976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:45.678822 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-75a64ba4-2c17-4763-bf21-72f815c55c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1367 microversion: 2.1 time: 0.159500 Aug 05 05:38:45.679546 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 860/1743] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:45 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:46.703869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:46.704880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:46.715756 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:46.716270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:46.716702 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:46.717398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:46.717846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:46.718264 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:46.860907 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:46.868477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9ebcabef-22ff-4a2f-9ce9-5f929b25c0b0 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1367 microversion: 2.1 time: 0.171179 Aug 05 05:38:46.869041 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 884/1744] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:46 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:47.865403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-3a3432d5-20f6-46b7-9093-ea21e9ad7443 req-18ec6202-3dee-4b89-b4e8-f260bf07c641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50a3344-e2e5-472d-ad37-8256ef7a8919", "name": "network-vif-plugged", "status": "completed", "tag": "c4a5b796-7b08-4ee3-b764-24bb8a0a7b79"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:38:47.870327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:47.876555 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-3a3432d5-20f6-46b7-9093-ea21e9ad7443 req-18ec6202-3dee-4b89-b4e8-f260bf07c641 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:47.877031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-3a3432d5-20f6-46b7-9093-ea21e9ad7443 req-18ec6202-3dee-4b89-b4e8-f260bf07c641 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:47.877453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-3a3432d5-20f6-46b7-9093-ea21e9ad7443 req-18ec6202-3dee-4b89-b4e8-f260bf07c641 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:47.889079 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:47.889608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:47.889890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-3a3432d5-20f6-46b7-9093-ea21e9ad7443 req-18ec6202-3dee-4b89-b4e8-f260bf07c641 service nova] Creating event network-vif-plugged:c4a5b796-7b08-4ee3-b764-24bb8a0a7b79 for instance c50a3344-e2e5-472d-ad37-8256ef7a8919 on hv-cinder-81558 Aug 05 05:38:47.895735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-3a3432d5-20f6-46b7-9093-ea21e9ad7443 req-18ec6202-3dee-4b89-b4e8-f260bf07c641 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089476 Aug 05 05:38:47.896642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 861/1745] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:38:47.896813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:47.897179 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:47.897632 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:47.898343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:47.898917 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:47.899256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:48.036225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:48.044012 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-32edc7e5-5c0d-44a6-929b-0175f9e80a26 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1367 microversion: 2.1 time: 0.158879 Aug 05 05:38:48.044578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 885/1746] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:47 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:38:49.070713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:49.072781 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:49.083468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:49.084354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:49.085094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:49.087220 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:49.088022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:49.088727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:49.226767 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:49.234584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-eb03e1d4-7f76-40b8-8573-ec6fda33f8cc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1367 microversion: 2.1 time: 0.171931 Aug 05 05:38:49.235148 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 862/1747] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:49 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:50.259527 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:50.260505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:50.271733 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:50.272589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:50.273289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:50.274805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:50.275573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:50.276320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:50.405960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:38:50.414120 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f04606cb-32f4-48b2-81fd-9e2e4552b6af tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1556 microversion: 2.1 time: 0.161250 Aug 05 05:38:50.414686 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 886/1748] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:38:50 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:38:50.434774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:38:50.435338 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:38:50.441939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:50.442413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:50.442845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:50.443534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:50.444021 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:50.444436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:50.533434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-003aca62-a73a-480c-ab37-aa28018b876a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102674 Aug 05 05:38:50.534005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 863/1749] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:38:50 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:38:51.489188 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-5c81b36f-1947-49c4-bd7e-a87e53edf73b req-b0e8e921-2cbe-4304-a7c6-4c9bfc9c9e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50a3344-e2e5-472d-ad37-8256ef7a8919", "tag": "c4a5b796-7b08-4ee3-b764-24bb8a0a7b79"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:38:51.493916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:38:51.500154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5c81b36f-1947-49c4-bd7e-a87e53edf73b req-b0e8e921-2cbe-4304-a7c6-4c9bfc9c9e45 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:38:51.500627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5c81b36f-1947-49c4-bd7e-a87e53edf73b req-b0e8e921-2cbe-4304-a7c6-4c9bfc9c9e45 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:38:51.501042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5c81b36f-1947-49c4-bd7e-a87e53edf73b req-b0e8e921-2cbe-4304-a7c6-4c9bfc9c9e45 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:38:51.512217 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-5c81b36f-1947-49c4-bd7e-a87e53edf73b req-b0e8e921-2cbe-4304-a7c6-4c9bfc9c9e45 service nova] Creating event network-changed:c4a5b796-7b08-4ee3-b764-24bb8a0a7b79 for instance c50a3344-e2e5-472d-ad37-8256ef7a8919 on hv-cinder-81558 Aug 05 05:38:51.519918 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-5c81b36f-1947-49c4-bd7e-a87e53edf73b req-b0e8e921-2cbe-4304-a7c6-4c9bfc9c9e45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034271 Aug 05 05:38:51.520755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 887/1750] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:39:26.313336 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:39:26.314434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:39:26.316564 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=5 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:39:26.317718 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=64 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:39:26.325051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:39:26.325875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:39:26.336862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:39:26.337343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:39:26.337784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:39:26.338458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:39:26.338897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:39:26.339311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:39:26.362473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b685788f-a146-473e-b19d-a433c1e053c5 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919/ips" status: 200 len: 148 microversion: 2.1 time: 0.050863 Aug 05 05:39:26.363019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 864/1751] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:39:26 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:41:29.850063 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a0560d8-b404-4c31-b1a2-75d2f7d1e20c] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 05 05:41:29.850676 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:41:29.851458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=92 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:41:29.856358 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-51a47a40-0e2a-4c6c-9c4d-79a1cf74e965 req-febde9ac-6a5d-4281-9991-6f0c50cdb60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5caff55-2233-4dbd-8296-3b018d176171", "name": "network-vif-deleted", "tag": "fc7ac303-cfb5-47ae-bde0-0a6abea4f8de"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:41:29.867785 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-51a47a40-0e2a-4c6c-9c4d-79a1cf74e965 req-febde9ac-6a5d-4281-9991-6f0c50cdb60a service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:41:29.868532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-51a47a40-0e2a-4c6c-9c4d-79a1cf74e965 req-febde9ac-6a5d-4281-9991-6f0c50cdb60a service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:41:29.868747 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-51a47a40-0e2a-4c6c-9c4d-79a1cf74e965 req-febde9ac-6a5d-4281-9991-6f0c50cdb60a service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:41:29.879833 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-51a47a40-0e2a-4c6c-9c4d-79a1cf74e965 req-febde9ac-6a5d-4281-9991-6f0c50cdb60a service nova] Creating event network-vif-deleted:fc7ac303-cfb5-47ae-bde0-0a6abea4f8de for instance b5caff55-2233-4dbd-8296-3b018d176171 on hv-cinder-81558 Aug 05 05:41:29.885162 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-51a47a40-0e2a-4c6c-9c4d-79a1cf74e965 req-febde9ac-6a5d-4281-9991-6f0c50cdb60a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036931 Aug 05 05:41:29.885943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 888/1752] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:41:33.248506 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:41:33.249334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:41:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:41:41.429910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:41:41.430963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:41:41.561574 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:41:41.562296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:41:42.033176 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:41:42.033355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:42:01.973270 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:42:01.974277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:43:39.154731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:43:39.155356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:43:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:44:53.261786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:44:53.263374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:45:01.443078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:45:01.444127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:45:01.574452 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:45:01.575367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:45:02.041891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:45:02.042067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:45:21.986418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:45:21.987312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:46:40.207444 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 05:46:40.208184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:40.208823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=4 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:40.212835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:40.213019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:40.219711 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:40.220243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:40.220670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:40.221348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:40.221791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:40.222205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:40.250092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:46:40.336770 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e6bde422-36a2-4bc6-ba8e-bb36da4b3a3d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 204 len: 0 microversion: 2.1 time: 0.132012 Aug 05 05:46:40.337700 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 865/1753] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:46:40 2022] DELETE /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:46:40.343908 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:40.345799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:40.350532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:40.351602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:40.359857 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:40.360343 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:40.360783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:40.361483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:40.361924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:40.362346 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:40.368599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a0560d8-b404-4c31-b1a2-75d2f7d1e20c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59620. Aug 05 05:46:40.632124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:40.640229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-874f7208-5cc2-4cfa-a579-08adc4a29709 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1680 microversion: 2.1 time: 0.298251 Aug 05 05:46:40.640843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 889/1754] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:40 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1680 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:41.662284 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:41.663008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:41.670932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:41.671408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:41.671865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:41.672560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:41.673008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:41.673422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:41.679006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59630. Aug 05 05:46:41.798299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:41.806775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dbe8f3c8-ba4b-4a6d-afb8-e396396e24ee tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 200 len: 1613 microversion: 2.1 time: 0.148788 Aug 05 05:46:41.807342 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 866/1755] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:41 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 1613 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:41.917249 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50a3344-e2e5-472d-ad37-8256ef7a8919", "name": "network-vif-deleted", "tag": "c4a5b796-7b08-4ee3-b764-24bb8a0a7b79"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:46:41.928031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:41.928754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:41.929362 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:41.942392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] Creating event network-vif-deleted:c4a5b796-7b08-4ee3-b764-24bb8a0a7b79 for instance c50a3344-e2e5-472d-ad37-8256ef7a8919 on hv-cinder-81558 Aug 05 05:46:41.946256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR oslo.messaging._drivers.impl_rabbit [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] [e8cafd8e-982c-4157-b7cd-6aa1bb3eee65] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:46:42.828608 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:42.829209 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:42.836794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:42.837269 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:42.837664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:42.838567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:42.839034 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:42.839447 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:42.853433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 HTTP/1.1 Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:46:42.855098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:46:42.857006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'c50a3344-e2e5-472d-ad37-8256ef7a8919'} Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:46:42.857946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:46:42.859545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:46:42.860956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:46:42.860956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-fb56bff0-7f02-45d7-b89d-b4adc15df0d3 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 404 len: 111 microversion: 2.1 time: 0.032089 Aug 05 05:46:42.860956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 867/1756] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:42 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:46:42.865348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-60d99fc7-6814-451f-9b9f-f970d5706244 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '.version_select at 0x7fdc9dcd7c10>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:42.889701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-60d99fc7-6814-451f-9b9f-f970d5706244 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723942568" status: 202 len: 0 microversion: 2.1 time: 0.028011 Aug 05 05:46:42.890289 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 868/1757] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Aug 5 05:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723942568 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:46:42.955437 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] [e8cafd8e-982c-4157-b7cd-6aa1bb3eee65] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59650. Aug 05 05:46:42.959681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-68e4b651-6810-4f64-b0ee-2f9472baca0f req-094543b8-8d38-46fa-8fca-990cb1144bf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.114587 Aug 05 05:46:42.960513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 890/1758] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:46:43.573914 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-856c7277-e3ac-426f-bcd8-c6bbf3476414 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: .version_select at 0x7fdca2482940>, body: {"keypair": {"name": "tempest-keypair-1929074703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSoM54GPzHZQv/MNdV6lO1Ft0nbPZhTTk5MQODC/2eBhVMF9c7L3S1bvlN9mxUdhYuq1CgvpaenlZF8wJiBmqMuU6wMy2+26G8JJHlXMTLbHk3v5RbhTi4zyxKNGfGcCg=="}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:46:43.590426 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-856c7277-e3ac-426f-bcd8-c6bbf3476414 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:46:43.594534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-856c7277-e3ac-426f-bcd8-c6bbf3476414 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:46:43.620234 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-856c7277-e3ac-426f-bcd8-c6bbf3476414 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049972 Aug 05 05:46:43.620993 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 869/1759] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:46:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:46:44.879793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2115819412", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dfb9760-7f7c-4d72-90dd-3ced7593c930"}], "security_groups": [{"name": "tempest-securitygroup--153995305"}], "key_name": "tempest-keypair-1929074703", "user_data": "}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:46:44.984768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] validate_networks() for [('8dfb9760-7f7c-4d72-90dd-3ced7593c930', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:46:45.711106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:46:45.711522 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:46:45.711994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:46:45.712396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:46:45.712804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:46:45.722794 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:45.723260 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:45.724408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:45.725144 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:45.725620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:45.726046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:45.743722 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:46:45.747700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Getting quotas for user 2637eface78b4813b91967ce66a59c00 and project e45c617eb5804c8187985b40e94329d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:46:45.758241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:46:45.760991 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:46:45.813195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bbc5ee1d-da83-4f84-8c8a-988ed3e60f0d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.938625 Aug 05 05:46:45.813934 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 891/1760] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:46:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:46:45.825297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-be9b10a3-9e59-4426-9d0d-9db236c3f6ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:45.825878 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-be9b10a3-9e59-4426-9d0d-9db236c3f6ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:45.878561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-be9b10a3-9e59-4426-9d0d-9db236c3f6ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:45.885695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-be9b10a3-9e59-4426-9d0d-9db236c3f6ab tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1242 microversion: 2.1 time: 0.064759 Aug 05 05:46:45.886262 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 870/1761] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:45 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:46.907540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:46.908159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:46.914988 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:46.915460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:46.915940 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:46.916639 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:46.917089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:46.917517 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:46.980858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:46.988731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-91d402f7-62d3-4528-bee2-79aec32a974f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1302 microversion: 2.1 time: 0.085989 Aug 05 05:46:46.989293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 892/1762] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:46 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:48.012504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:48.013238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:48.020537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:48.021115 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:48.021553 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:48.022264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:48.022715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:48.023140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:48.230060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:48.237780 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9bfd269a-43a7-4ac5-9db5-64414801f023 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.230991 Aug 05 05:46:48.238421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 871/1763] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:48 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:48.842096 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-632fbd77-9b51-4502-9979-d3c7b1c6deae req-33c80341-5d42-46ac-8ad9-aa4455240c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18ea2ff-5a2b-45bb-8623-2780d7c81450", "tag": "b5a19f58-3118-4213-8151-4132f2e0b028"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:46:48.861745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-632fbd77-9b51-4502-9979-d3c7b1c6deae req-33c80341-5d42-46ac-8ad9-aa4455240c73 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:48.862590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-632fbd77-9b51-4502-9979-d3c7b1c6deae req-33c80341-5d42-46ac-8ad9-aa4455240c73 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:48.863046 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-632fbd77-9b51-4502-9979-d3c7b1c6deae req-33c80341-5d42-46ac-8ad9-aa4455240c73 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:48.875454 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-632fbd77-9b51-4502-9979-d3c7b1c6deae req-33c80341-5d42-46ac-8ad9-aa4455240c73 service nova] Creating event network-changed:b5a19f58-3118-4213-8151-4132f2e0b028 for instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 on hv-cinder-81558 Aug 05 05:46:48.880601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-632fbd77-9b51-4502-9979-d3c7b1c6deae req-33c80341-5d42-46ac-8ad9-aa4455240c73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042424 Aug 05 05:46:48.881187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 893/1764] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:46:49.260779 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:49.261463 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:49.269893 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:49.270367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:49.270798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:49.271492 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:49.271982 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:49.272383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:49.417028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:49.425826 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-95f740f8-a71e-4f98-a7a9-426879655fa4 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.170970 Aug 05 05:46:49.426414 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 872/1765] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:49 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:50.447689 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:50.448581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:50.455294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:50.455795 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:50.456246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:50.456937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:50.457396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:50.457813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:50.608692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:50.616380 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8dbc9994-5065-4e33-bf45-8787698ff0b9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.173463 Aug 05 05:46:50.616933 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 894/1766] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:50 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:51.641653 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:51.642622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:51.653571 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:51.654410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:51.655120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:51.656335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:51.656818 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:51.657231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:51.795158 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:51.803343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-558d1ca5-35ef-4ff7-9e79-c1885cfdeaff tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.168639 Aug 05 05:46:51.803949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 873/1767] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:51 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:52.828544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:52.829403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:52.840515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:52.841326 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:52.842056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:52.843206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:52.843923 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:52.844351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:52.985050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:52.992740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-02d4c577-f127-4649-99f0-90c4ae71484c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.170913 Aug 05 05:46:52.993549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 895/1768] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:52 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:54.017558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:54.018076 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:54.025019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:54.025501 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:54.025935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:54.026622 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:54.027064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:54.027482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:54.172260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:54.179667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-269a8b7c-ddde-40fb-89f3-d8557a5fcecf tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.167865 Aug 05 05:46:54.180295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 874/1769] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:54 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:54.267377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-7a5d7382-df0a-44ff-b01e-1111eb27438e req-012efea2-631d-448e-bf27-a985834c1f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18ea2ff-5a2b-45bb-8623-2780d7c81450", "name": "network-vif-plugged", "status": "completed", "tag": "b5a19f58-3118-4213-8151-4132f2e0b028"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:46:54.276948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7a5d7382-df0a-44ff-b01e-1111eb27438e req-012efea2-631d-448e-bf27-a985834c1f48 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:54.277408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7a5d7382-df0a-44ff-b01e-1111eb27438e req-012efea2-631d-448e-bf27-a985834c1f48 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:54.277830 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-7a5d7382-df0a-44ff-b01e-1111eb27438e req-012efea2-631d-448e-bf27-a985834c1f48 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:54.288882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-7a5d7382-df0a-44ff-b01e-1111eb27438e req-012efea2-631d-448e-bf27-a985834c1f48 service nova] Creating event network-vif-plugged:b5a19f58-3118-4213-8151-4132f2e0b028 for instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 on hv-cinder-81558 Aug 05 05:46:54.293824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-7a5d7382-df0a-44ff-b01e-1111eb27438e req-012efea2-631d-448e-bf27-a985834c1f48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082430 Aug 05 05:46:54.294395 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 896/1770] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:46:55.200842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:55.201432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:55.208500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:55.208987 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:55.209423 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:55.210104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:55.210535 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:55.210970 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:55.348503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:55.356450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bbb54a74-2b6f-4205-9504-55df1595d6fc tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1367 microversion: 2.1 time: 0.159493 Aug 05 05:46:55.357042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 875/1771] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:55 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:56.379299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:56.380563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:56.387449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:56.388659 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:56.396582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:56.397087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:56.397496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:56.398214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:56.398684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:56.399107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:56.532458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:46:56.541102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-43d254e6-4e61-421a-9ea7-ac2eee0a4ae9 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1556 microversion: 2.1 time: 0.164274 Aug 05 05:46:56.541678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 897/1772] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:46:56 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:46:56.561834 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:46:56.562716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:46:56.564612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:46:56.570415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:56.570899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:56.571312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:56.572054 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:56.572518 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:56.572919 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:56.655365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-175d1ed9-6028-4487-8749-b66000189c3f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097443 Aug 05 05:46:56.656041 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 876/1773] 10.222.0.30 () {58 vars in 1275 bytes} [Fri Aug 5 05:46:56 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:46:57.603245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-934021b9-8744-4797-889a-63f212787ae4 req-d0baf7c7-2731-49bd-ab92-55c3308a3069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18ea2ff-5a2b-45bb-8623-2780d7c81450", "tag": "b5a19f58-3118-4213-8151-4132f2e0b028"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:46:57.613407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-934021b9-8744-4797-889a-63f212787ae4 req-d0baf7c7-2731-49bd-ab92-55c3308a3069 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:46:57.613879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-934021b9-8744-4797-889a-63f212787ae4 req-d0baf7c7-2731-49bd-ab92-55c3308a3069 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:46:57.614309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-934021b9-8744-4797-889a-63f212787ae4 req-d0baf7c7-2731-49bd-ab92-55c3308a3069 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:46:57.625793 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-934021b9-8744-4797-889a-63f212787ae4 req-d0baf7c7-2731-49bd-ab92-55c3308a3069 service nova] Creating event network-changed:b5a19f58-3118-4213-8151-4132f2e0b028 for instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 on hv-cinder-81558 Aug 05 05:46:57.631200 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-934021b9-8744-4797-889a-63f212787ae4 req-d0baf7c7-2731-49bd-ab92-55c3308a3069 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031675 Aug 05 05:46:57.631799 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 898/1774] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:47:27.018483 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:47:27.019322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:47:27.023942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:47:27.024416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:47:27.032790 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:47:27.033439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:47:27.033863 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:47:27.034796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:47:27.035244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:47:27.035658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:47:27.061486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-25f6b42c-a8bf-4b7d-b42d-9df1d17d39bd tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/ips" status: 200 len: 148 microversion: 2.1 time: 0.044504 Aug 05 05:47:27.062027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 877/1775] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:47:27 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:48:21.456675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:48:21.457744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:48:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:48:22.051015 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:48:22.051498 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:48:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:49:53.274628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:49:53.275521 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:50:01.590458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:50:01.591221 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:50:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:51:35.761354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a0560d8-b404-4c31-b1a2-75d2f7d1e20c] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:51:35.762008 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:51:35.762853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=40 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:51:35.767571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06acaf74-1559-401c-9658-442d89fdd559"}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:51:35.770035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:35.778305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:35.778783 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:35.779214 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:35.779935 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:35.780381 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:35.780802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:35.859094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [e8cafd8e-982c-4157-b7cd-6aa1bb3eee65] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:51:36.770389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a0560d8-b404-4c31-b1a2-75d2f7d1e20c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33218. Aug 05 05:51:36.870592 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [e8cafd8e-982c-4157-b7cd-6aa1bb3eee65] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33220. Aug 05 05:51:39.464202 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4481c631-7b54-4ca5-afd0-0a632c79f519 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "POST /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.704309 Aug 05 05:51:39.464965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 899/1776] 10.222.0.30 () {60 vars in 1323 bytes} [Fri Aug 5 05:51:35 2022] POST /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments => generated 194 bytes in 3706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:51:41.470275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:51:41.471263 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:51:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:51:42.061328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:51:42.062071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:51:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:51:52.508905 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 05:51:52.515895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:52.515895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:52.523650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=4 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:51:52.524549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:51:52.526337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:52.526972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:52.527582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:52.528581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:52.529036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:52.529639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:52.940067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lazy-loading 'services' on Instance uuid d18ea2ff-5a2b-45bb-8623-2780d7c81450 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:51:53.049972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [65bc5fa6-ef18-441c-a406-23ff7a16c945] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:51:53.529904 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33440. Aug 05 05:51:54.057717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [65bc5fa6-ef18-441c-a406-23ff7a16c945] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33444. Aug 05 05:51:54.062877 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c55ccec7-0a3f-423f-8101-e6ecc3a3a39d tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments/06acaf74-1559-401c-9658-442d89fdd559" status: 202 len: 0 microversion: 2.1 time: 1.555866 Aug 05 05:51:54.068007 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 878/1777] 10.222.0.30 () {58 vars in 1416 bytes} [Fri Aug 5 05:51:52 2022] DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments/06acaf74-1559-401c-9658-442d89fdd559 => generated 0 bytes in 1562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:51:54.070477 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:51:54.078457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:51:54.086365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:54.097994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:54.123707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:54.124483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:54.125091 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:54.125964 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:54.126554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:54.127117 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:54.190905 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3495b432-29a5-4153-b7a4-9f6668868e94 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121810 Aug 05 05:51:54.196319 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 900/1778] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:51:54 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:51:55.203839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:55.206910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:55.213672 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:55.214231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:55.214869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:55.215415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:55.215890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:55.216307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:55.248015 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5bf0bf0a-aa10-451f-8281-aaee34bdf60f tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049004 Aug 05 05:51:55.248577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 879/1779] 10.222.0.30 () {58 vars in 1302 bytes} [Fri Aug 5 05:51:55 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 05:51:55.322019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:55.322530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:55.329429 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:55.330072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:55.330660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:55.331401 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:55.331872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:55.332440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:55.359759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:51:55.473323 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bb40cce6-7302-417d-9e1e-948a9f2b38da tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 204 len: 0 microversion: 2.1 time: 0.152135 Aug 05 05:51:55.474398 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 901/1780] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:51:55 2022] DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:51:55.485921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:55.486686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:55.495821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:55.496558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:55.497319 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:55.498196 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:55.499370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:55.500065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:55.673741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:51:55.682581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-53d29de1-9ce9-45ae-b1c1-3c2ff952ce0a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1680 microversion: 2.1 time: 0.204085 Aug 05 05:51:55.683313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 880/1781] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:51:55 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:51:56.000955 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ff8c8173-23b7-4724-97df-fe7f1ac004f0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Action: 'create', calling method: .version_select at 0x7fdc9d956d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1690838167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqHNNJ2FrdOW593vh0ALAnAVq5FykTQ52HmLVE6UEkFB8bX6IzYLgTdLqQhVp6otT3YG5sERkdw6u64CxkN/Uwno/5UzOJDtiP7Z9jZ608+aAQ0f742AWY0Zooqtzz/MA=="}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:51:56.017403 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-ff8c8173-23b7-4724-97df-fe7f1ac004f0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Getting quotas for project e217bd57daf74e9f8e7033fbf4111555. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:51:56.021347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-ff8c8173-23b7-4724-97df-fe7f1ac004f0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Getting quotas for user 9673e5094962449ea96235ca6c397ea3 and project e217bd57daf74e9f8e7033fbf4111555. Resources: {'key_pairs'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:51:56.047476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ff8c8173-23b7-4724-97df-fe7f1ac004f0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.179228 Aug 05 05:51:56.048114 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 902/1782] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:51:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:51:56.704986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:56.705642 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:56.716452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:56.717138 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:56.718191 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:56.725167 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:56.725845 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:56.727345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:57.022321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:51:57.032322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a8c10bb5-af56-46ac-a7fc-95843733a774 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1680 microversion: 2.1 time: 0.330981 Aug 05 05:51:57.032946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 881/1783] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:51:56 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1680 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:51:57.968596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-f3e28bef-d332-4acf-8175-62b6b9190a76 req-334ce998-99a9-4d99-a044-88a57222e03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18ea2ff-5a2b-45bb-8623-2780d7c81450", "name": "network-vif-deleted", "tag": "b5a19f58-3118-4213-8151-4132f2e0b028"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:51:58.006229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-f3e28bef-d332-4acf-8175-62b6b9190a76 req-334ce998-99a9-4d99-a044-88a57222e03d service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:58.006709 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-f3e28bef-d332-4acf-8175-62b6b9190a76 req-334ce998-99a9-4d99-a044-88a57222e03d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:58.007139 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-f3e28bef-d332-4acf-8175-62b6b9190a76 req-334ce998-99a9-4d99-a044-88a57222e03d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:58.049472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-f3e28bef-d332-4acf-8175-62b6b9190a76 req-334ce998-99a9-4d99-a044-88a57222e03d service nova] Creating event network-vif-deleted:b5a19f58-3118-4213-8151-4132f2e0b028 for instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 on hv-cinder-81558 Aug 05 05:51:58.054548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:58.055161 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:58.066291 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:58.073741 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:58.074204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:58.074791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-f3e28bef-d332-4acf-8175-62b6b9190a76 req-334ce998-99a9-4d99-a044-88a57222e03d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276625 Aug 05 05:51:58.074953 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:58.075729 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 903/1784] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:51:58.077865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:58.077865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:58.127490 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:58.128225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:58.128658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:58.129118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lazy-loading 'fault' on Instance uuid d18ea2ff-5a2b-45bb-8623-2780d7c81450 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:51:58.187250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637eface78b4813b91967ce66a59c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c617eb5804c8187985b40e94329d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:51:58.197328 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d44a7bcd-b300-487d-9387-200fd1979977 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 200 len: 1332 microversion: 2.1 time: 0.145727 Aug 05 05:51:58.198227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 882/1785] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:51:58 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:51:59.220354 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:59.221191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:51:59.240369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:59.241141 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:59.242256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:59.243193 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:51:59.244813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:51:59.245508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:51:59.264288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 HTTP/1.1 Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:51:59.266458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:51:59.267541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'd18ea2ff-5a2b-45bb-8623-2780d7c81450'} Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:51:59.268225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:51:59.273666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:51:59.274742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:51:59.274742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-eb6d0244-2929-439f-a7a0-5ede2e8d2cf6 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 404 len: 111 microversion: 2.1 time: 0.053063 Aug 05 05:51:59.274742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 904/1786] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:51:59 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:51:59.278554 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb1f2b45-be11-43f6-a18a-683a53954766 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '.version_select at 0x7fdc9de45550>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:51:59.304825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bb1f2b45-be11-43f6-a18a-683a53954766 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929074703" status: 202 len: 0 microversion: 2.1 time: 0.030840 Aug 05 05:51:59.305413 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 883/1787] 10.222.0.30 () {58 vars in 1221 bytes} [Fri Aug 5 05:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929074703 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:52:01.223598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:01.224088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:01.230981 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:01.231469 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:01.231949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:01.232641 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:01.233099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:01.233585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:01.251717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 HTTP/1.1 Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:52:01.253396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.254434 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'd18ea2ff-5a2b-45bb-8623-2780d7c81450'} Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:52:01.254992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.256296 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.257430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:52:01.257430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f8a1acd8-24aa-4056-ba39-25ab3f3de6d2 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 404 len: 111 microversion: 2.1 time: 0.035567 Aug 05 05:52:01.257430 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 905/1788] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:52:01 2022] DELETE /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:52:01.264692 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:01.265435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: d18ea2ff-5a2b-45bb-8623-2780d7c81450] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:01.272809 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:01.273295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:01.273723 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:01.274431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:01.274831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:01.275246 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:01.288821 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 HTTP/1.1 Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:52:01.290557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.291695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'd18ea2ff-5a2b-45bb-8623-2780d7c81450'} Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:52:01.292295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. Aug 05 05:52:01.293176 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:01.294017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance d18ea2ff-5a2b-45bb-8623-2780d7c81450 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:52:01.294017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-12c2d18c-5c7f-43db-816e-b4604fc19c90 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450" status: 404 len: 111 microversion: 2.1 time: 0.031804 Aug 05 05:52:01.294017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 884/1789] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:01 2022] GET /compute/v2.1/servers/d18ea2ff-5a2b-45bb-8623-2780d7c81450 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:52:02.436330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:02.437238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:02.444534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.445040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.445476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.446140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.446798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.447237 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.468744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 HTTP/1.1 Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:52:02.470339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.471678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'c50a3344-e2e5-472d-ad37-8256ef7a8919'} Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:52:02.472315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.476725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.477612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:52:02.477612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-cc8a95a6-ef9c-4e07-b415-55aae23ece34 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 404 len: 111 microversion: 2.1 time: 0.039446 Aug 05 05:52:02.477612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 906/1790] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:52:02 2022] DELETE /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:52:02.480735 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:02.481316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: c50a3344-e2e5-472d-ad37-8256ef7a8919] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:02.488317 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.488801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.489321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.490020 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.490487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.490910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.506553 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 HTTP/1.1 Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:52:02.508218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.509241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'c50a3344-e2e5-472d-ad37-8256ef7a8919'} Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:52:02.509801 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. Aug 05 05:52:02.510724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.511610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance c50a3344-e2e5-472d-ad37-8256ef7a8919 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:52:02.511610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1e82c194-6ded-47a4-80b7-76ff7db5af53 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919" status: 404 len: 111 microversion: 2.1 time: 0.033078 Aug 05 05:52:02.511610 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 885/1791] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:02 2022] GET /compute/v2.1/servers/c50a3344-e2e5-472d-ad37-8256ef7a8919 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:52:02.518864 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:02.519320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:02.525787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.526291 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.526695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.527379 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.527856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.528279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.541716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f HTTP/1.1 Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:52:02.543257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.544541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '3ac3edaa-53ee-49c7-b154-c73b0d93e41f'} Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:52:02.545265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.546924 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.548215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:52:02.548215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e6af9472-3cc6-4a25-a142-72f7f0491c7c tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 404 len: 111 microversion: 2.1 time: 0.029945 Aug 05 05:52:02.548215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 907/1792] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:52:02 2022] DELETE /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 05:52:02.555094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:02.555094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: 3ac3edaa-53ee-49c7-b154-c73b0d93e41f] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:02.560370 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.560859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.561312 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.562012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:02.562454 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:02.562860 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:02.577159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f HTTP/1.1 Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:52:02.578739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.579961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '3ac3edaa-53ee-49c7-b154-c73b0d93e41f'} Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:52:02.580656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. Aug 05 05:52:02.581747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:52:02.582916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance 3ac3edaa-53ee-49c7-b154-c73b0d93e41f could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:52:02.582916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bb7e5dbf-f096-4943-8719-1cc36fcaa356 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f" status: 404 len: 111 microversion: 2.1 time: 0.031465 Aug 05 05:52:02.583910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 886/1793] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:02 2022] GET /compute/v2.1/servers/3ac3edaa-53ee-49c7-b154-c73b0d93e41f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:52:14.870812 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-921645496", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1690838167", "security_groups": [{"name": "tempest-secgroup-smoke-1371096154"}], "networks": [{"uuid": "321a7d78-842b-4a47-8e88-7edc774c2add"}], "block_device_mapping_v2": [{"uuid": "3290020f-bb4b-41ea-8665-82de62dc6f18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:52:14.880942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=4 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:14.881618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:14.882279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:15.218010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] validate_networks() for [('321a7d78-842b-4a47-8e88-7edc774c2add', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:52:15.697583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:52:15.698010 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:52:15.698515 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:52:15.698922 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:52:15.699328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:52:15.708933 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:15.709410 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:15.709824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:15.710542 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:15.710986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:15.711409 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:15.728645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Getting quotas for project e217bd57daf74e9f8e7033fbf4111555. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:52:15.733067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Getting quotas for user 9673e5094962449ea96235ca6c397ea3 and project e217bd57daf74e9f8e7033fbf4111555. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:52:15.797431 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:52:15.800636 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3290020f-bb4b-41ea-8665-82de62dc6f18',volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:52:15.944646 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4427d227-d1e9-4fba-909b-8a70b33d3296 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.078009 Aug 05 05:52:15.945644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 908/1794] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:52:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:52:15.956398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-64c7a9b9-bb61-465a-9f7d-c81dcd2d3f94 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:15.956996 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-64c7a9b9-bb61-465a-9f7d-c81dcd2d3f94 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:15.959478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:15.960152 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:16.022304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-64c7a9b9-bb61-465a-9f7d-c81dcd2d3f94 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:16.029525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-64c7a9b9-bb61-465a-9f7d-c81dcd2d3f94 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1088 microversion: 2.1 time: 0.076932 Aug 05 05:52:16.030114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 887/1795] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:15 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:17.051111 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:17.051727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:17.058568 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:17.059051 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:17.059487 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:17.060216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:17.060651 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:17.061086 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:17.126945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:17.136414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8ff5f4db-349c-42cf-a9e7-0e46692f7563 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1186 microversion: 2.1 time: 0.089705 Aug 05 05:52:17.137191 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 909/1796] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:17 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:18.157720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:18.158233 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:18.167045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:18.167532 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:18.168081 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:18.168819 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:18.169260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:18.169675 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:18.371545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:18.379482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-31a5e5c0-070e-47ef-a02f-1226fef36618 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.225775 Aug 05 05:52:18.380238 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 888/1797] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:18 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:18.638821 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-b7e5702a-9fea-4ffe-988a-6ca32ed2656e req-fbaaf7cb-6efd-4046-937a-b7f07b37b6cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:52:18.649840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-b7e5702a-9fea-4ffe-988a-6ca32ed2656e req-fbaaf7cb-6efd-4046-937a-b7f07b37b6cf service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:18.650435 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-b7e5702a-9fea-4ffe-988a-6ca32ed2656e req-fbaaf7cb-6efd-4046-937a-b7f07b37b6cf service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:18.650979 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-b7e5702a-9fea-4ffe-988a-6ca32ed2656e req-fbaaf7cb-6efd-4046-937a-b7f07b37b6cf service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:18.662365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-b7e5702a-9fea-4ffe-988a-6ca32ed2656e req-fbaaf7cb-6efd-4046-937a-b7f07b37b6cf service nova] Creating event network-changed:2294ff35-b093-45aa-9585-be166e190fa9 for instance 5bda3919-c397-4585-bd5d-489e0f0965e0 on hv-cinder-81558 Aug 05 05:52:18.667585 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-b7e5702a-9fea-4ffe-988a-6ca32ed2656e req-fbaaf7cb-6efd-4046-937a-b7f07b37b6cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032507 Aug 05 05:52:18.668364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 910/1798] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:52:19.404313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:19.404938 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:19.411688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:19.412216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:19.412650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:19.413348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:19.413800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:19.414219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:19.634688 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:19.644411 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9ddecbf0-6f49-4dca-aa18-bc829c6ec405 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.245730 Aug 05 05:52:19.645000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 889/1799] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:19 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:20.670741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:20.672006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:20.682569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:20.683360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:20.684279 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:20.685418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:20.686211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:20.687001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:20.826931 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:20.834961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8a3ed05d-513b-44dc-9cf1-5edcef7af2e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.172302 Aug 05 05:52:20.835529 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 911/1800] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:20 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:21.856373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:21.856990 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:21.863823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:21.864329 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:21.864757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:21.865450 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:21.865895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:21.866315 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:22.001792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:22.010455 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-304cf32a-c2a3-4287-92b4-6ec969f98148 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.158178 Aug 05 05:52:22.010961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 890/1801] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:21 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:23.032018 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:23.032613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:23.039463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:23.039992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:23.040426 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:23.041115 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:23.041570 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:23.041990 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:23.176920 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:23.184749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-36ab678a-0f8d-40a1-a1b5-af6bc2a3fa5f tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.156759 Aug 05 05:52:23.185318 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 912/1802] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:23 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:24.216002 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:24.217004 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:24.227277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:24.228140 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:24.228910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:24.230016 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:24.230671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:24.231085 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:24.364936 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:24.372601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3733bfe2-66c2-4506-8765-a0c761ffbe11 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.163088 Aug 05 05:52:24.373168 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 891/1803] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:24 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:25.397765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:25.398668 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:25.407095 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:25.407596 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:25.408064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:25.408759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:25.409216 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:25.409638 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:25.540124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:25.548602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-19eb169d-160d-48f7-a8d4-e035959eb321 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.157567 Aug 05 05:52:25.549197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 913/1804] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:25 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:26.571884 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:26.572603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:26.575383 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:26.581221 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:26.581820 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:26.582392 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:26.583074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:26.583504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:26.583949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:26.719948 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:26.727789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a17a9982-e45e-4620-b5aa-4e09db78421b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.161392 Aug 05 05:52:26.728389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 892/1805] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:26 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:27.753071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:27.754070 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:27.757545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:27.758676 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:52:27.769862 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:27.770658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:27.771366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:27.772537 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:27.773280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:27.773960 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:27.924742 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:27.932727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e8ab3b53-b2d0-4e52-885c-1daf49cf0409 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.186350 Aug 05 05:52:27.933303 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 914/1806] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:27 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:28.957730 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:28.958731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:28.968365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:28.968850 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:28.969279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:28.969972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:28.970415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:28.970833 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:29.116973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:29.126473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-564ae83e-2095-4828-ae67-e9832048ed53 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.175478 Aug 05 05:52:29.127005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 893/1807] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:28 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:30.118863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-5a0d595c-32f4-486f-b5fa-3942ef5888c1 req-e113da9f-8e2c-4a15-a535-f653725df7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "name": "network-vif-plugged", "status": "completed", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:52:30.128406 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5a0d595c-32f4-486f-b5fa-3942ef5888c1 req-e113da9f-8e2c-4a15-a535-f653725df7b9 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:30.128879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5a0d595c-32f4-486f-b5fa-3942ef5888c1 req-e113da9f-8e2c-4a15-a535-f653725df7b9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:30.129355 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5a0d595c-32f4-486f-b5fa-3942ef5888c1 req-e113da9f-8e2c-4a15-a535-f653725df7b9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:30.140507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-5a0d595c-32f4-486f-b5fa-3942ef5888c1 req-e113da9f-8e2c-4a15-a535-f653725df7b9 service nova] Creating event network-vif-plugged:2294ff35-b093-45aa-9585-be166e190fa9 for instance 5bda3919-c397-4585-bd5d-489e0f0965e0 on hv-cinder-81558 Aug 05 05:52:30.145712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-5a0d595c-32f4-486f-b5fa-3942ef5888c1 req-e113da9f-8e2c-4a15-a535-f653725df7b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092638 Aug 05 05:52:30.146345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 915/1808] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:52:30.147620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:30.148373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:30.154798 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:30.155272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:30.155695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:30.156435 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:30.156875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:30.157316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:30.292326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:30.300584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bccd6562-b514-4255-93d8-564c8dfb42a6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.157798 Aug 05 05:52:30.301108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 894/1809] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:30 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:31.327685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:31.328745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:31.339357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:31.340218 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:31.341001 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:31.341707 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:31.342151 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:31.342564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:31.502366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:31.513778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d074a166-ae47-4e7a-b5c2-1b72b0a69093 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1260 microversion: 2.1 time: 0.193724 Aug 05 05:52:31.514647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 916/1810] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:31 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:32.544305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:32.545058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:32.553231 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:32.553827 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:32.554359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:32.555207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:32.555757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:32.556397 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:32.691155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:32.702800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-05eb2b19-22c6-4917-9d8b-7967c689f09d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1444 microversion: 2.1 time: 0.164877 Aug 05 05:52:32.703599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 895/1811] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:32 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:32.723102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:52:32.723715 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:52:32.730619 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:32.731094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:32.731541 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:32.732294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:32.732726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:32.733146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:32.872661 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:52:32.881211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b67fc600-18c4-4ff1-881b-60b7e7921112 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1444 microversion: 2.1 time: 0.162004 Aug 05 05:52:32.881791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 917/1812] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:52:32 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:52:34.846305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-383996c0-0f89-4e59-bf67-c2a597f26f47 req-fe4aff4a-2e68-4dac-a7d0-ac8844570eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:52:34.856350 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-383996c0-0f89-4e59-bf67-c2a597f26f47 req-fe4aff4a-2e68-4dac-a7d0-ac8844570eff service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:52:34.857005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-383996c0-0f89-4e59-bf67-c2a597f26f47 req-fe4aff4a-2e68-4dac-a7d0-ac8844570eff service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:52:34.857496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-383996c0-0f89-4e59-bf67-c2a597f26f47 req-fe4aff4a-2e68-4dac-a7d0-ac8844570eff service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:52:34.868891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-383996c0-0f89-4e59-bf67-c2a597f26f47 req-fe4aff4a-2e68-4dac-a7d0-ac8844570eff service nova] Creating event network-changed:2294ff35-b093-45aa-9585-be166e190fa9 for instance 5bda3919-c397-4585-bd5d-489e0f0965e0 on hv-cinder-81558 Aug 05 05:52:34.874334 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-383996c0-0f89-4e59-bf67-c2a597f26f47 req-fe4aff4a-2e68-4dac-a7d0-ac8844570eff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031746 Aug 05 05:52:34.875259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 896/1813] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:54:29.047322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:54:29.048052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=48 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:54:29.052765 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:54:29.053338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:29.060869 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:29.061363 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:29.061798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:29.062476 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:29.062916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:29.063325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:29.085891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lazy-loading 'flavor' on Instance uuid 5bda3919-c397-4585-bd5d-489e0f0965e0 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:54:29.161530 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6b58a13f-158b-402a-9085-300194334939 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "POST /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0/action" status: 202 len: 0 microversion: 2.1 time: 0.115961 Aug 05 05:54:29.162116 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 918/1814] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:54:29 2022] POST /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:54:29.171225 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 05 05:54:29.171935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=22 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:54:29.172656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=50 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:54:29.177388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:29.178094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:29.185427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:29.185905 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:29.186337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:29.187031 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:29.187451 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:29.187903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:29.329445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:29.338910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6fa108d6-b165-4619-8fc0-d946d8faff06 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.171222 Aug 05 05:54:29.339606 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 897/1815] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:29 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:30.365631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:30.366474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:30.375189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:30.375843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:30.376439 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:30.377393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:30.377986 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:30.378540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:30.516209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:30.524187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-02d6e355-3c40-4c9f-b89c-673f9c1fced6 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.166225 Aug 05 05:54:30.524746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 919/1816] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:30 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:31.549264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:31.550184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:31.563281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:31.564139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:31.564855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:31.566118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:31.566603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:31.567009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:31.572393 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34094. Aug 05 05:54:31.704000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:31.715480 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e9f8653b-41c4-4e52-a25b-91d6adf9370b tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.172490 Aug 05 05:54:31.716278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 898/1817] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:31 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:32.743017 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:32.744057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:32.755348 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:32.756199 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:32.756916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:32.758050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:32.758789 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:32.759480 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:32.899329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:32.910645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3a90c139-25f5-4329-8cb3-6a9658aeccd9 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.174376 Aug 05 05:54:32.911405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 920/1818] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:32 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:33.935942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:33.936939 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:33.945422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:33.945905 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:33.946333 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:33.947019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:33.947464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:33.947917 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:34.092504 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:34.101976 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-aff9ae3a-e335-4d1e-8951-bd1dae21bb77 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.172519 Aug 05 05:54:34.102897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 899/1819] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:33 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:35.131146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:35.132204 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:35.143040 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:35.143828 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:35.144587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:35.145634 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:35.146087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:35.146507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:35.284983 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:35.292746 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5f28d610-6d3b-42ac-9e25-f40a3187f227 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.168656 Aug 05 05:54:35.293306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 921/1820] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:35 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:36.317205 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:36.317835 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:36.324547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:36.325022 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:36.325445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:36.326120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:36.326556 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:36.326969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:36.463678 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:36.471505 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ac5efa7b-2185-465d-9e59-30d564a6f056 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.160707 Aug 05 05:54:36.472109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 900/1821] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:36 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:37.496738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:37.497735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:37.507236 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:37.507802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:37.508252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:37.508944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:37.509393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:37.509813 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:37.650238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:37.657927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3b984090-f4d1-4e4c-b931-af3db5ef3b5e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.167750 Aug 05 05:54:37.658504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 922/1822] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:37 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:38.684318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:38.685268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:38.696206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:38.696967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:38.697679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:38.698815 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:38.699543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:38.700311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:38.834199 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:38.841859 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c60ad4d5-4b9e-4344-b9d3-6889f462bad3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.164220 Aug 05 05:54:38.842398 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 901/1823] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:38 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:39.862690 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:39.863307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:39.871006 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:39.871534 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:39.872347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:39.873586 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:39.874285 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:39.874800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:40.030802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:40.038696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5f363ea5-439c-4b75-87f3-73cebe871722 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.179971 Aug 05 05:54:40.039265 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 923/1824] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:39 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:41.068255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:41.069274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:41.080417 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:41.081245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:41.081969 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:41.083103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:41.083755 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:41.084202 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:41.214908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:41.225682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a74955f5-a4ba-4ec8-b77a-b2e78a05b00a tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.164018 Aug 05 05:54:41.226249 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 902/1825] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:41 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:42.250717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:42.251543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:42.260234 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:42.260713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:42.261149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:42.261831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:42.262271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:42.262688 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:42.400996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:42.408778 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-95743786-038c-4c38-ab6e-23cc27c5c3a1 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1570 microversion: 2.1 time: 0.164743 Aug 05 05:54:42.409947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 924/1826] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:42 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:42.430251 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:54:42.430855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:42.437379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:42.437866 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:42.438297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:42.438981 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:42.439429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:42.439869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:42.540584 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117903) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 05:54:42.613109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [702da474-af52-4627-b27a-7b66ff6d671b] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:54:43.625705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [702da474-af52-4627-b27a-7b66ff6d671b] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34142. Aug 05 05:54:43.631245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-80c4120b-cdb4-4882-a3e1-16e13ff68f3e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "POST /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0/action" status: 202 len: 0 microversion: 2.1 time: 1.205231 Aug 05 05:54:43.632051 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 903/1827] 10.222.0.30 () {60 vars in 1278 bytes} [Fri Aug 5 05:54:42 2022] POST /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0/action => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:54:43.640295 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:43.641590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:43.648190 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:43.648669 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:43.649100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:43.649787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:43.650230 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:43.650644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:43.783442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:43.791465 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7f0d3553-fceb-4b1b-a237-e8a3a6727447 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1518 microversion: 2.1 time: 0.154977 Aug 05 05:54:43.792345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 925/1828] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:43 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:44.565057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-43d10044-bd16-4c37-874a-f8b73dfb7ddc req-f4f74227-7b69-473a-b29e-a9f84d9cdf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:54:44.579694 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-43d10044-bd16-4c37-874a-f8b73dfb7ddc req-f4f74227-7b69-473a-b29e-a9f84d9cdf28 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:44.580439 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-43d10044-bd16-4c37-874a-f8b73dfb7ddc req-f4f74227-7b69-473a-b29e-a9f84d9cdf28 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:44.581062 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-43d10044-bd16-4c37-874a-f8b73dfb7ddc req-f4f74227-7b69-473a-b29e-a9f84d9cdf28 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:44.593390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.compute.server_external_events [req-43d10044-bd16-4c37-874a-f8b73dfb7ddc req-f4f74227-7b69-473a-b29e-a9f84d9cdf28 service nova] Unable to find a host for instance 5bda3919-c397-4585-bd5d-489e0f0965e0. Dropping event network-vif-unplugged {{(pid=117903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 05:54:44.594306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-43d10044-bd16-4c37-874a-f8b73dfb7ddc req-f4f74227-7b69-473a-b29e-a9f84d9cdf28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035969 Aug 05 05:54:44.594890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 904/1829] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 05:54:44.812900 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:44.813543 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:44.820408 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:44.820886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:44.821347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:44.822030 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:44.822471 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:44.822877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:44.966106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:44.973856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b81cec64-72d0-4a7c-b404-e4608052128d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1520 microversion: 2.1 time: 0.164917 Aug 05 05:54:44.974438 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 926/1830] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:44 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:45.995475 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:45.996090 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:46.004017 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:46.004503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:46.004937 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:46.005722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:46.006159 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:46.006576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:46.143732 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:46.151669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8a9ec26a-c76e-455e-8e06-2cd2dc3992e5 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.160355 Aug 05 05:54:46.152285 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 905/1831] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:45 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:47.177183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:47.177843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:47.187108 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:47.187740 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:47.188353 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:47.189255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:47.189845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:47.190399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:47.328058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:47.335914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a36dcd55-a652-4386-92ad-22e4d2d4d694 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.165499 Aug 05 05:54:47.336482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 927/1832] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:47 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:48.358290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:48.358856 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:48.367566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:48.368093 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:48.368531 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:48.369244 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:48.369697 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:48.370118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:48.501748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:48.511887 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3bb99cc5-e1de-4b4d-b80f-377d752f8262 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.157945 Aug 05 05:54:48.512489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 906/1833] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:48 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:49.540606 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:49.541580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:49.552486 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:49.553271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:49.553984 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:49.555107 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:49.555867 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:49.556640 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:49.701109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:49.713743 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-03ada6b7-29b6-44ac-a464-e5d071780fee tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.179536 Aug 05 05:54:49.714513 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 928/1834] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:49 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:50.742951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:50.743757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:50.752660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:50.753664 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:50.754260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:50.755174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:50.755726 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:50.756369 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:50.893513 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:50.901341 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-53da717f-f86c-47d8-9a7d-ecb25f7c7658 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.164778 Aug 05 05:54:50.901925 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 907/1835] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:50 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:51.926754 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:51.927744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:51.938791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:51.939581 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:51.940344 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:51.941466 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:51.942207 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:51.942903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:52.078232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:52.086021 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-28cfe9a7-c018-4966-907a-718d977a282d tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.166150 Aug 05 05:54:52.086728 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 929/1836] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:51 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:53.106812 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:53.107365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:53.114903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:53.115523 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:53.116101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:53.116855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:53.117309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:53.117764 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:53.249679 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:53.257739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1b496153-71a7-445f-8554-f56c2b263cba tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.154910 Aug 05 05:54:53.258327 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 908/1837] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:53 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:53.288992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:54:53.289149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 05:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:54:54.290305 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:54.291140 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:54.301839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:54.302623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:54.303331 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:54.304496 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:54.305280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:54.305697 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:54.438332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:54.446002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3a26d713-f746-4850-a924-d0b69200ad17 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.162528 Aug 05 05:54:54.446576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 930/1838] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:54 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:54.661643 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "name": "network-vif-plugged", "status": "completed", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:54:54.673108 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:54.673583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:54.674003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:54.685695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] Creating event network-vif-plugged:2294ff35-b093-45aa-9585-be166e190fa9 for instance 5bda3919-c397-4585-bd5d-489e0f0965e0 on hv-cinder-81558 Aug 05 05:54:54.689297 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] [65bc5fa6-ef18-441c-a406-23ff7a16c945] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 05:54:55.466544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:55.467913 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:55.476338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:55.477189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:55.477876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:55.478563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:55.479005 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:55.479415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:55.617098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:55.629420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c54b82e1-f9e9-46b6-a58c-c5452a3a9c64 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.166425 Aug 05 05:54:55.630369 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 931/1839] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:55 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:55.696950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] [65bc5fa6-ef18-441c-a406-23ff7a16c945] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34214. Aug 05 05:54:55.700481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-4947872d-1545-4328-8628-07ce102576ec req-581f5c17-b428-484c-8bab-e5605c3045bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.042969 Aug 05 05:54:55.701097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 909/1840] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:54:56.656243 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:56.657246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:56.668255 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:56.669061 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:56.669779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:56.670914 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:56.671660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:56.672418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:56.693993 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:54:56.818483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:56.826658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d51f116a-84c1-4b9f-a348-072b8f920533 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1576 microversion: 2.1 time: 0.177175 Aug 05 05:54:56.827272 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 932/1841] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:56 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:54:57.853277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:54:57.853995 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:54:57.861753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:57.862360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:57.862865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:57.863671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:54:57.864247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:54:57.864754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:54:58.003794 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:54:58.012053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f543dbb8-ad45-417b-8c46-2832ff27526e tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1563 microversion: 2.1 time: 0.166784 Aug 05 05:54:58.012618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 910/1842] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:54:57 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:55:01.606292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:55:01.607195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:55:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:55:02.074187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 05:55:02.074422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 05:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 05:56:08.786381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:08.787173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:08.787309 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:08.787741 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:08.791282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=30 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:08.792104 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:08.793888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-b5d54e10-e082-466a-83da-8f978e87521e req-d924572f-9489-4e29-8e60-2e66ba873d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:56:08.796270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:08.796786 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:08.797208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:08.797895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:08.798367 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:08.798945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:08.805706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b5d54e10-e082-466a-83da-8f978e87521e req-d924572f-9489-4e29-8e60-2e66ba873d86 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:08.806259 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b5d54e10-e082-466a-83da-8f978e87521e req-d924572f-9489-4e29-8e60-2e66ba873d86 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:08.806753 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b5d54e10-e082-466a-83da-8f978e87521e req-d924572f-9489-4e29-8e60-2e66ba873d86 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:08.820811 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-b5d54e10-e082-466a-83da-8f978e87521e req-d924572f-9489-4e29-8e60-2e66ba873d86 service nova] Creating event network-changed:2294ff35-b093-45aa-9585-be166e190fa9 for instance 5bda3919-c397-4585-bd5d-489e0f0965e0 on hv-cinder-81558 Aug 05 05:56:08.827433 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:56:08.827605 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-b5d54e10-e082-466a-83da-8f978e87521e req-d924572f-9489-4e29-8e60-2e66ba873d86 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042143 Aug 05 05:56:08.828187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 911/1843] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:56:08.910229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e3dc24c6-7bd8-4178-94e4-ebf9f81f98c0 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 204 len: 0 microversion: 2.1 time: 0.127429 Aug 05 05:56:08.911734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 933/1844] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:56:08 2022] DELETE /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:56:08.922942 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:08.923868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:08.933432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:08.934193 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:08.934977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:08.935961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:08.936621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:08.937922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:09.117226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:09.125204 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-00aa56c4-3c94-48b0-83ab-cc367538c7e7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.207897 Aug 05 05:56:09.125880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 912/1845] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:08 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:10.148464 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:10.149177 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:10.156101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:10.156590 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:10.157025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:10.157750 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:10.158197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:10.158620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:10.367735 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:10.376124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-8ddc81b1-6cbd-458e-8d78-0b5bc2457ba3 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1569 microversion: 2.1 time: 0.231899 Aug 05 05:56:10.376705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 934/1846] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:10 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:11.104313 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-97fbe0e4-f69c-4f63-b0ad-56f4a08e78e3 req-fb9978b2-6751-444d-9f21-d0c4625dc12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bda3919-c397-4585-bd5d-489e0f0965e0", "name": "network-vif-deleted", "tag": "2294ff35-b093-45aa-9585-be166e190fa9"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:56:11.114337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-97fbe0e4-f69c-4f63-b0ad-56f4a08e78e3 req-fb9978b2-6751-444d-9f21-d0c4625dc12f service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:11.114810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-97fbe0e4-f69c-4f63-b0ad-56f4a08e78e3 req-fb9978b2-6751-444d-9f21-d0c4625dc12f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:11.115227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-97fbe0e4-f69c-4f63-b0ad-56f4a08e78e3 req-fb9978b2-6751-444d-9f21-d0c4625dc12f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:11.128211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-97fbe0e4-f69c-4f63-b0ad-56f4a08e78e3 req-fb9978b2-6751-444d-9f21-d0c4625dc12f service nova] Creating event network-vif-deleted:2294ff35-b093-45aa-9585-be166e190fa9 for instance 5bda3919-c397-4585-bd5d-489e0f0965e0 on hv-cinder-81558 Aug 05 05:56:11.133276 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-97fbe0e4-f69c-4f63-b0ad-56f4a08e78e3 req-fb9978b2-6751-444d-9f21-d0c4625dc12f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032593 Aug 05 05:56:11.134174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 913/1847] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:56:11.398247 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:11.398974 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:11.407246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:11.407831 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:11.408483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:11.409147 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:11.409734 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:11.410293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:11.474849 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673e5094962449ea96235ca6c397ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217bd57daf74e9f8e7033fbf4111555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:11.482915 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ac76f548-ac00-40be-bfe9-c7157cb6b1b7 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 200 len: 1219 microversion: 2.1 time: 0.088890 Aug 05 05:56:11.483446 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 935/1848] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:11 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:12.509985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:12.513715 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] [instance: 5bda3919-c397-4585-bd5d-489e0f0965e0] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:12.520145 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:12.520626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:12.521057 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:12.522073 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:12.522528 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:12.522945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:12.536503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] HTTP exception thrown: Instance 5bda3919-c397-4585-bd5d-489e0f0965e0 could not be found. Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Request method failure captured: Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 HTTP/1.1 Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7K_2BKfzWrzzloTQ-1IoS9GQszL6d1u8DVsVOA2uj7IIY5vkNXo_hxzKnzgfWgU7pHZpCKrhY3HHrmZDtkCisxzAwE85YJ-yLvddebQi2kl9mdyRAooOZLF5gVVjxEHyusUXH9OTR81lwW8BK7zBlCRM8tOqcv116gnZ08BLEavuv_I Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e217bd57daf74e9f8e7033fbf4111555 Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-TestShelveInstance-1871481855 Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:56:12.538131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e217bd57daf74e9f8e7033fbf4111555", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e217bd57daf74e9f8e7033fbf4111555"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e217bd57daf74e9f8e7033fbf4111555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e217bd57daf74e9f8e7033fbf4111555"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-TestShelveInstance-1871481855 Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e217bd57daf74e9f8e7033fbf4111555 Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-TestShelveInstance-1871481855 Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-TestShelveInstance-1871481855-project Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 9673e5094962449ea96235ca6c397ea3 Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-TestShelveInstance-1871481855-project Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 5bda3919-c397-4585-bd5d-489e0f0965e0 could not be found. Aug 05 05:56:12.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '5bda3919-c397-4585-bd5d-489e0f0965e0'} Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bda3919-c397-4585-bd5d-489e0f0965e0 could not be found. Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:56:12.540281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bda3919-c397-4585-bd5d-489e0f0965e0 could not be found. Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bda3919-c397-4585-bd5d-489e0f0965e0 could not be found. Aug 05 05:56:12.541509 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:56:12.542660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Returning 404 to user: Instance 5bda3919-c397-4585-bd5d-489e0f0965e0 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:56:12.542660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e42a954e-d43a-4e78-9f08-7128f2eed714 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0" status: 404 len: 111 microversion: 2.1 time: 0.037870 Aug 05 05:56:12.542660 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 914/1849] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:12 2022] GET /compute/v2.1/servers/5bda3919-c397-4585-bd5d-489e0f0965e0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:56:12.717780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-61d8aa4b-e705-48ac-b8e7-497158ca7961 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] Calling method '.version_select at 0x7fdc9dd22670>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:12.744263 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-61d8aa4b-e705-48ac-b8e7-497158ca7961 tempest-TestShelveInstance-1871481855 tempest-TestShelveInstance-1871481855-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1690838167" status: 202 len: 0 microversion: 2.1 time: 0.030260 Aug 05 05:56:12.745093 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 936/1850] 10.222.0.30 () {58 vars in 1254 bytes} [Fri Aug 5 05:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1690838167 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 05:56:29.758163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=8 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:29.758889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=12 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:29.928437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-43ee559e-466f-45bf-8c23-1303ff4a89ab tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Action: 'create', calling method: .version_select at 0x7fdc9daf4790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1947595121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGafows/ljUX2WRf1n/XjuojZkrYPoh5oW9Vw+qN1WPxQXgLqu0Xxwefv/QRUFZ/BGwrektJEHawyrRHOzfTjYpjguOjeoLSsgU1R3+qZ6xeEZCuRTYEInYAB4zcrHZzEA=="}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:56:29.944438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-43ee559e-466f-45bf-8c23-1303ff4a89ab tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for project d93689b1aaa347368f1f590eb6b494cb. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:56:29.948438 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-43ee559e-466f-45bf-8c23-1303ff4a89ab tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for user 4f727e9d632e4592b82ebd1f00cdf8df and project d93689b1aaa347368f1f590eb6b494cb. Resources: {'key_pairs'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:56:29.977250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-43ee559e-466f-45bf-8c23-1303ff4a89ab tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.224997 Aug 05 05:56:29.977954 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 915/1851] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Aug 5 05:56:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:56:46.374721 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:46.375621 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:46.380397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-773684125", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1947595121", "security_groups": [{"name": "tempest-secgroup-smoke-330230172"}], "block_device_mapping_v2": [{"uuid": "e53214bc-96df-49c2-86bc-f5f2abb5c975", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7420a8bf-5805-4b36-aff6-79e0ea4322eb"}]}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:56:46.499617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] validate_networks() for [('7420a8bf-5805-4b36-aff6-79e0ea4322eb', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:56:46.901961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:56:46.902696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:56:46.903171 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:56:46.903575 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:56:46.904033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:56:46.913535 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:46.913989 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:46.914417 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:46.915134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:46.915589 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:46.916039 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:46.933463 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for project d93689b1aaa347368f1f590eb6b494cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:56:46.937937 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for user 4f727e9d632e4592b82ebd1f00cdf8df and project d93689b1aaa347368f1f590eb6b494cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:56:46.999422 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:56:47.001571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e53214bc-96df-49c2-86bc-f5f2abb5c975',volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:56:47.140462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ace5e99e-8229-4277-9105-a1036ad0da20 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767161 Aug 05 05:56:47.141101 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 937/1852] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:56:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:56:47.152395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0eae9606-ae46-4319-9585-756c6cb1cb15 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:47.152892 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0eae9606-ae46-4319-9585-756c6cb1cb15 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:47.155797 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=4 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:47.156728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:47.211038 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0eae9606-ae46-4319-9585-756c6cb1cb15 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:47.218056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0eae9606-ae46-4319-9585-756c6cb1cb15 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1094 microversion: 2.1 time: 0.069885 Aug 05 05:56:47.218663 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 916/1853] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:47 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:48.239259 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:48.240072 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:48.246745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:48.247229 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:48.247660 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:48.248388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:48.248839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:48.249256 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:48.329270 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:48.337094 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-11619882-dcbc-4e76-86dd-6829f6052256 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1200 microversion: 2.1 time: 0.102008 Aug 05 05:56:48.337842 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 938/1854] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:48 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:49.357316 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:49.358056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:49.364895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:49.365307 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:49.365740 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:49.367071 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:49.367529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:49.368089 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:49.585645 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:49.590318 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c9eb0836-6ef6-40cd-aa18-045cec875bce tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.236851 Aug 05 05:56:49.603591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 917/1855] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:49 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:49.761238 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-9870940a-db24-4f31-b05f-4ddb66157aca req-6052c4ab-277b-46f4-ba6d-efc7a3a2389c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8cc6fea-ff45-4fab-80eb-202ca0225928", "tag": "ae8bf989-e35a-4964-9a86-c04cd9b5bddb"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:56:49.772432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9870940a-db24-4f31-b05f-4ddb66157aca req-6052c4ab-277b-46f4-ba6d-efc7a3a2389c service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:49.773192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9870940a-db24-4f31-b05f-4ddb66157aca req-6052c4ab-277b-46f4-ba6d-efc7a3a2389c service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:49.773664 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9870940a-db24-4f31-b05f-4ddb66157aca req-6052c4ab-277b-46f4-ba6d-efc7a3a2389c service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:49.784826 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-9870940a-db24-4f31-b05f-4ddb66157aca req-6052c4ab-277b-46f4-ba6d-efc7a3a2389c service nova] Creating event network-changed:ae8bf989-e35a-4964-9a86-c04cd9b5bddb for instance a8cc6fea-ff45-4fab-80eb-202ca0225928 on hv-cinder-81558 Aug 05 05:56:49.789889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-9870940a-db24-4f31-b05f-4ddb66157aca req-6052c4ab-277b-46f4-ba6d-efc7a3a2389c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Aug 05 05:56:49.790482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 939/1856] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:56:50.610558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:50.611157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:50.617874 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:50.618353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:50.618775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:50.619448 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:50.619916 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:50.620347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:50.814627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:50.822682 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4fd31ab6-85c2-4b37-a155-921666f4389e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.215972 Aug 05 05:56:50.823278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 918/1857] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:50 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:51.849364 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:51.850526 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:51.861110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:51.861921 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:51.862647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:51.863841 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:51.864598 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:51.865322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:52.003158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:52.011161 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a379da5f-4bbe-4e6f-8786-eee2b304c4f4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.169856 Aug 05 05:56:52.011787 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 940/1858] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:51 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:53.034094 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:53.034706 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:53.041633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:53.042128 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:53.042566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:53.043372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:53.043829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:53.044278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:53.316139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:53.324255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8225f935-29dd-42d7-ae7f-6cb1e67a7517 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.294173 Aug 05 05:56:53.324949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 919/1859] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:53 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:54.349411 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:54.350360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:54.361282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:54.362090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:54.362814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:54.364016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:54.364820 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:54.365532 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:54.507241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:54.515736 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7cbbf5c8-4c51-452b-bda5-0ff040f97d21 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.172930 Aug 05 05:56:54.516338 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 941/1860] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:54 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:55.536813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:55.537408 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:55.544686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:55.545163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:55.545717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:55.546409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:55.546851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:55.547265 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:55.682345 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:55.690471 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-99ab43bd-55d2-4dab-a955-a804c3580ae9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.157657 Aug 05 05:56:55.691028 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 920/1861] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:55 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:56.715942 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:56.717007 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:56.728232 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:56.729035 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:56.729755 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:56.730890 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:56.731642 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:56.732397 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:56.870366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:56.878618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-577965d8-7a4c-4cd4-ad6f-751ddc533a23 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.169233 Aug 05 05:56:56.879184 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 942/1862] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:56 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:57.900714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:57.901274 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:57.903618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:57.909503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:57.909989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:57.910421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:57.911105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:57.911549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:57.912006 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:58.055673 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:58.063387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5ffe3668-1a86-45d2-a821-4d3f10eca7aa tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.166712 Aug 05 05:56:58.063972 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 921/1863] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:57 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:56:59.084109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:56:59.084731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:56:59.086724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:59.087396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:56:59.095544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:59.096206 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:59.096750 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:59.097578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:59.098266 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:59.098814 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:59.217825 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-6c68347a-c3f5-48be-93d4-4d5ccc06bcd8 req-0c1ad25e-2523-484e-b5c0-1ce82e42f5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc6fea-ff45-4fab-80eb-202ca0225928", "name": "network-vif-plugged", "status": "completed", "tag": "ae8bf989-e35a-4964-9a86-c04cd9b5bddb"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:56:59.229839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-6c68347a-c3f5-48be-93d4-4d5ccc06bcd8 req-0c1ad25e-2523-484e-b5c0-1ce82e42f5bf service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:56:59.230568 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-6c68347a-c3f5-48be-93d4-4d5ccc06bcd8 req-0c1ad25e-2523-484e-b5c0-1ce82e42f5bf service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:56:59.230999 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-6c68347a-c3f5-48be-93d4-4d5ccc06bcd8 req-0c1ad25e-2523-484e-b5c0-1ce82e42f5bf service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:56:59.242356 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-6c68347a-c3f5-48be-93d4-4d5ccc06bcd8 req-0c1ad25e-2523-484e-b5c0-1ce82e42f5bf service nova] Creating event network-vif-plugged:ae8bf989-e35a-4964-9a86-c04cd9b5bddb for instance a8cc6fea-ff45-4fab-80eb-202ca0225928 on hv-cinder-81558 Aug 05 05:56:59.242489 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:56:59.247900 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-6c68347a-c3f5-48be-93d4-4d5ccc06bcd8 req-0c1ad25e-2523-484e-b5c0-1ce82e42f5bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034515 Aug 05 05:56:59.248894 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 922/1864] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:56:59.252684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2c42a5cb-3f35-457a-a656-4de0a01345ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.172611 Aug 05 05:56:59.253458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 943/1865] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:56:59 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:57:00.274813 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:57:00.275486 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:57:00.281869 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:00.282359 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:00.282792 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:00.283603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:00.284078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:00.284500 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:00.436432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:57:00.444111 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-510aaa8b-003e-40b4-9a28-91d5fb1b285f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1265 microversion: 2.1 time: 0.174226 Aug 05 05:57:00.444658 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 923/1866] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:57:00 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:57:01.468903 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:57:01.469906 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:57:01.477100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:01.477578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:01.478013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:01.478700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:01.479153 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:01.479576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:01.620656 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:57:01.629373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ffcc99f6-4cbc-4e4f-9665-9bfbd5128b00 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1453 microversion: 2.1 time: 0.167071 Aug 05 05:57:01.629961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 944/1867] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:57:01 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:57:01.649479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:57:01.650092 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:57:01.656586 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:01.657074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:01.657514 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:01.658295 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:01.658748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:01.659164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:01.802172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:57:01.810433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-dbaad2e6-9e2f-49fa-97d9-60182defb65e tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1453 microversion: 2.1 time: 0.164767 Aug 05 05:57:01.810932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 924/1868] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:57:01 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:57:03.844130 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-9ea2b9d8-629a-432d-930c-7bd614ff4d6c req-680067a0-adc4-47fd-b5e0-fb720562b33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8cc6fea-ff45-4fab-80eb-202ca0225928", "tag": "ae8bf989-e35a-4964-9a86-c04cd9b5bddb"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:57:03.853623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9ea2b9d8-629a-432d-930c-7bd614ff4d6c req-680067a0-adc4-47fd-b5e0-fb720562b33f service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:57:03.854102 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9ea2b9d8-629a-432d-930c-7bd614ff4d6c req-680067a0-adc4-47fd-b5e0-fb720562b33f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:57:03.854554 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9ea2b9d8-629a-432d-930c-7bd614ff4d6c req-680067a0-adc4-47fd-b5e0-fb720562b33f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:57:03.865440 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-9ea2b9d8-629a-432d-930c-7bd614ff4d6c req-680067a0-adc4-47fd-b5e0-fb720562b33f service nova] Creating event network-changed:ae8bf989-e35a-4964-9a86-c04cd9b5bddb for instance a8cc6fea-ff45-4fab-80eb-202ca0225928 on hv-cinder-81558 Aug 05 05:57:03.870633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-9ea2b9d8-629a-432d-930c-7bd614ff4d6c req-680067a0-adc4-47fd-b5e0-fb720562b33f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088432 Aug 05 05:57:03.871227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 945/1869] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:58:02.109288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=20 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:02.110098 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=44 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:02.115519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:02.116109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:02.126526 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:02.127250 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:02.127997 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:02.129012 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:02.129670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:02.130402 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:02.144308 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf HTTP/1.1 Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:58:02.145961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.147241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'e365c429-240d-4397-a002-eae5c51453cf'} Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:02.147950 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.149388 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.150707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:02.150707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-df6b899c-5aa6-4cc1-a8d0-a66d1daf03d8 tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 404 len: 111 microversion: 2.1 time: 0.041056 Aug 05 05:58:02.150707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 925/1870] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:58:02 2022] DELETE /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:58:02.154024 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:02.154774 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=42 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:02.159054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:02.159751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] [instance: e365c429-240d-4397-a002-eae5c51453cf] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:02.167703 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:02.168197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:02.168647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:02.169310 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:02.169759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:02.170175 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:02.183602 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] HTTP exception thrown: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Request method failure captured: Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf HTTP/1.1 Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7KggZyB4Vd_CoEOohGY8RdqYLGtz4uRj60Glsj3Nrm1ZSMpExXgVjtOSABBHGaBK2O-sMb1qW9gtQDbOGJa4TN_3Vb1FlZRpeBXmp7Cn_5ii308EnlzYN5BTLoyp40lGNeW3ds2jnbjNXNqkIV16zNI3VWYKEzceSPM5nHfXwFWnrpA Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:58:02.185257 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e45c617eb5804c8187985b40e94329d7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e45c617eb5804c8187985b40e94329d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: e45c617eb5804c8187985b40e94329d7 Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534789002 Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 2637eface78b4813b91967ce66a59c00 Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-AttachVolumeNegativeTest-534789002-project Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.186645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'e365c429-240d-4397-a002-eae5c51453cf'} Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:02.187432 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. Aug 05 05:58:02.188840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:02.190033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] Returning 404 to user: Instance e365c429-240d-4397-a002-eae5c51453cf could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:02.190033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5d1cec71-1d27-4e86-90b1-50386592438a tempest-AttachVolumeNegativeTest-534789002 tempest-AttachVolumeNegativeTest-534789002-project] 10.222.0.30 "GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf" status: 404 len: 111 microversion: 2.1 time: 0.034436 Aug 05 05:58:02.190033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 946/1871] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:02 2022] GET /compute/v2.1/servers/e365c429-240d-4397-a002-eae5c51453cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:58:06.747552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c3e1c50e-632b-4b29-b90e-88aec1f65102 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Action: 'create', calling method: .version_select at 0x7fdc9dc2d700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2118610846", "metadata": {"Type": "work"}}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c3e1c50e-632b-4b29-b90e-88aec1f65102 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Request method failure captured: Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 122 Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7LFuJx0MEPaLaliUwkojSBH8_YicZMAYUWQcyTq-NBtjnWkvXW-yIHnONMmPAKctBCrHpEqkNQb6tHmKNEux6CH88yo82N4HbeKb9BRKgBnomHH0vgmOxxIkkYL00PW64HE3rISAYDY4JIFerSgT15Yfq1cW9X7UktmNJGRCJIItJp0 Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:58:06.763064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c46538f0eda54a198f3085ca9a4d097f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: c7c75eebcb6846309aaf2e83215f5552 Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2118610846", "metadata": {"Type": "work"}}} Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:58:06.764428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2118610846', 'metadata': {'Type': 'work'}}}} Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise error Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:06.765304 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 05:58:06.766691 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 05:58:06.768395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 05:58:06.768395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.768395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c3e1c50e-632b-4b29-b90e-88aec1f65102 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:06.768395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c3e1c50e-632b-4b29-b90e-88aec1f65102 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133358 Aug 05 05:58:06.769261 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 926/1872] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Aug 5 05:58:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:58:06.774875 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bce6e19e-2340-4ece-a394-d4986b30e58c tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Action: 'create', calling method: .version_select at 0x7fdc9db3a280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1209368734", "metadata": {"Type": "work"}}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bce6e19e-2340-4ece-a394-d4986b30e58c tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Request method failure captured: Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 120 Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LFuJx0MEPaLaliUwkojSBH8_YicZMAYUWQcyTq-NBtjnWkvXW-yIHnONMmPAKctBCrHpEqkNQb6tHmKNEux6CH88yo82N4HbeKb9BRKgBnomHH0vgmOxxIkkYL00PW64HE3rISAYDY4JIFerSgT15Yfq1cW9X7UktmNJGRCJIItJp0 Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:58:06.779388 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c46538f0eda54a198f3085ca9a4d097f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c7c75eebcb6846309aaf2e83215f5552 Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1209368734", "metadata": {"Type": "work"}}} Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: Aug 05 05:58:06.780790 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1209368734', 'metadata': {'Type': 'work'}}}} Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise error Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi '0' Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:06.781610 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 05:58:06.783002 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 05:58:06.784160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 05:58:06.784160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.784160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bce6e19e-2340-4ece-a394-d4986b30e58c tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:06.784160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bce6e19e-2340-4ece-a394-d4986b30e58c tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009927 Aug 05 05:58:06.784160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 947/1873] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Aug 5 05:58:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:58:06.791677 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5781b261-1ea7-4e76-9867-234311c3c019 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Action: 'create', calling method: .version_select at 0x7fdc9db22280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1987999312", "metadata": {"Type": "work"}}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5781b261-1ea7-4e76-9867-234311c3c019 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Request method failure captured: Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 119 Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7LFuJx0MEPaLaliUwkojSBH8_YicZMAYUWQcyTq-NBtjnWkvXW-yIHnONMmPAKctBCrHpEqkNQb6tHmKNEux6CH88yo82N4HbeKb9BRKgBnomHH0vgmOxxIkkYL00PW64HE3rISAYDY4JIFerSgT15Yfq1cW9X7UktmNJGRCJIItJp0 Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:58:06.795278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c46538f0eda54a198f3085ca9a4d097f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: c7c75eebcb6846309aaf2e83215f5552 Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1987999312", "metadata": {"Type": "work"}}} Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:58:06.796888 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1987999312', 'metadata': {'Type': 'work'}}}} Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise error Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi '' Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:06.797722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 05:58:06.799104 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 05:58:06.800335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 05:58:06.800335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.800335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5781b261-1ea7-4e76-9867-234311c3c019 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:06.800335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5781b261-1ea7-4e76-9867-234311c3c019 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009922 Aug 05 05:58:06.800335 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 927/1874] 10.222.0.30 () {60 vars in 1156 bytes} [Fri Aug 5 05:58:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 05:58:06.806211 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-237b476d-d1cf-4666-9fe9-fbfc3ef3ab30 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Calling method '.version_select at 0x7fdc9d931550>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:06.943716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-237b476d-d1cf-4666-9fe9-fbfc3ef3ab30 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] HTTP exception thrown: Volume tempest-invalid-739476724 could not be found. Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-237b476d-d1cf-4666-9fe9-fbfc3ef3ab30 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Request method failure captured: Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-739476724 HTTP/1.1 Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LFuJx0MEPaLaliUwkojSBH8_YicZMAYUWQcyTq-NBtjnWkvXW-yIHnONMmPAKctBCrHpEqkNQb6tHmKNEux6CH88yo82N4HbeKb9BRKgBnomHH0vgmOxxIkkYL00PW64HE3rISAYDY4JIFerSgT15Yfq1cW9X7UktmNJGRCJIItJp0 Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:58:06.945834 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c46538f0eda54a198f3085ca9a4d097f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c7c75eebcb6846309aaf2e83215f5552 Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Volume tempest-invalid-739476724 could not be found. Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'tempest-invalid-739476724'} Aug 05 05:58:06.947124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-739476724 could not be found. (HTTP 404) (Request-ID: req-1b7129cc-39bd-43ab-8106-50921e779e6f) Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.949090 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 05:58:06.950349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-739476724 could not be found. Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:06.951501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-739476724 could not be found. Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-739476724 could not be found. Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-237b476d-d1cf-4666-9fe9-fbfc3ef3ab30 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Returning 404 to user: Volume tempest-invalid-739476724 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-237b476d-d1cf-4666-9fe9-fbfc3ef3ab30 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-739476724" status: 404 len: 98 microversion: 2.1 time: 0.145386 Aug 05 05:58:06.952910 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 948/1875] 10.222.0.30 () {58 vars in 1215 bytes} [Fri Aug 5 05:58:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-739476724 => generated 98 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 05:58:06.957458 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7ec68d58-7b08-4c3f-a530-819c2803f97a tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003899 Aug 05 05:58:06.957935 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 928/1876] 10.222.0.30 () {58 vars in 1140 bytes} [Fri Aug 5 05:58:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 05 05:58:06.966242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-225b92e6-68ab-48e1-8830-5e3c78283665 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003663 Aug 05 05:58:06.966720 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 949/1877] 10.222.0.30 () {58 vars in 1137 bytes} [Fri Aug 5 05:58:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 05:58:06.974713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b5dc2d7f-85c2-403a-ba95-ded57374b8b0 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Calling method '.version_select at 0x7fdc9dd51af0>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:07.004255 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-b5dc2d7f-85c2-403a-ba95-ded57374b8b0 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] HTTP exception thrown: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b5dc2d7f-85c2-403a-ba95-ded57374b8b0 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Request method failure captured: Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: DELETE /compute/v2.1/os-volumes/e86991ee-ec7f-4c14-9f18-4289e31a0767 HTTP/1.1 Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7LFuJx0MEPaLaliUwkojSBH8_YicZMAYUWQcyTq-NBtjnWkvXW-yIHnONMmPAKctBCrHpEqkNQb6tHmKNEux6CH88yo82N4HbeKb9BRKgBnomHH0vgmOxxIkkYL00PW64HE3rISAYDY4JIFerSgT15Yfq1cW9X7UktmNJGRCJIItJp0 Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:58:07.006211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c46538f0eda54a198f3085ca9a4d097f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: c7c75eebcb6846309aaf2e83215f5552 Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'e86991ee-ec7f-4c14-9f18-4289e31a0767'} Aug 05 05:58:07.007659 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. (HTTP 404) (Request-ID: req-3bbe6966-e59d-4d14-8509-8f041d1bd513) Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:07.008545 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 05:58:07.009823 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 05:58:07.010842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b5dc2d7f-85c2-403a-ba95-ded57374b8b0 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Returning 404 to user: Volume e86991ee-ec7f-4c14-9f18-4289e31a0767 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b5dc2d7f-85c2-403a-ba95-ded57374b8b0 tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/e86991ee-ec7f-4c14-9f18-4289e31a0767" status: 404 len: 109 microversion: 2.1 time: 0.036331 Aug 05 05:58:07.011922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 929/1878] 10.222.0.30 () {58 vars in 1248 bytes} [Fri Aug 5 05:58:06 2022] DELETE /compute/v2.1/os-volumes/e86991ee-ec7f-4c14-9f18-4289e31a0767 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:58:07.018717 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-94a2294e-b0c9-45a0-b3f2-37cfc07a172f tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Calling method '.version_select at 0x7fdc9db3ae50>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:07.046607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-94a2294e-b0c9-45a0-b3f2-37cfc07a172f tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] HTTP exception thrown: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-94a2294e-b0c9-45a0-b3f2-37cfc07a172f tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Request method failure captured: Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/os-volumes/47552d79-5607-477d-af7c-2f8bbe626769 HTTP/1.1 Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LFuJx0MEPaLaliUwkojSBH8_YicZMAYUWQcyTq-NBtjnWkvXW-yIHnONMmPAKctBCrHpEqkNQb6tHmKNEux6CH88yo82N4HbeKb9BRKgBnomHH0vgmOxxIkkYL00PW64HE3rISAYDY4JIFerSgT15Yfq1cW9X7UktmNJGRCJIItJp0 Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:58:07.048580 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c46538f0eda54a198f3085ca9a4d097f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c46538f0eda54a198f3085ca9a4d097f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: c46538f0eda54a198f3085ca9a4d097f Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-VolumesNegativeTest-1455113520 Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: c7c75eebcb6846309aaf2e83215f5552 Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-VolumesNegativeTest-1455113520-project Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '47552d79-5607-477d-af7c-2f8bbe626769'} Aug 05 05:58:07.049939 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. (HTTP 404) (Request-ID: req-8381c9c8-cac5-4325-a87a-aa010886602b) Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:07.050810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 05:58:07.052149 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 05:58:07.053679 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-94a2294e-b0c9-45a0-b3f2-37cfc07a172f tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] Returning 404 to user: Volume 47552d79-5607-477d-af7c-2f8bbe626769 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-94a2294e-b0c9-45a0-b3f2-37cfc07a172f tempest-VolumesNegativeTest-1455113520 tempest-VolumesNegativeTest-1455113520-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/47552d79-5607-477d-af7c-2f8bbe626769" status: 404 len: 109 microversion: 2.1 time: 0.035241 Aug 05 05:58:07.054766 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 950/1879] 10.222.0.30 () {58 vars in 1245 bytes} [Fri Aug 5 05:58:07 2022] GET /compute/v2.1/os-volumes/47552d79-5607-477d-af7c-2f8bbe626769 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:58:19.002754 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:19.003519 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:19.009008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1187612888", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "networks": [{"uuid": "016676d6-00c7-42a2-b42f-8a1c9e230620"}]}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:19.062607 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] validate_networks() for [('016676d6-00c7-42a2-b42f-8a1c9e230620', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:58:19.435197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:58:19.435669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:58:19.436173 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:58:19.436577 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:58:19.436985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:58:19.446578 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:19.447027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:19.447453 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:19.448201 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:19.448650 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:19.449068 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:19.466590 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Getting quotas for project d9c62c503f4844babfd2528fa8c0722f. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:58:19.471064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Getting quotas for user 947f7daa83a94adbad8ef6d4a737eccf and project d9c62c503f4844babfd2528fa8c0722f. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:58:19.482720 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:58:19.485100 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:58:19.537946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4ffbcc2f-0d74-416c-b16b-8cea70189160 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540708 Aug 05 05:58:19.538599 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 930/1880] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:58:19.547781 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:19.548612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:19.553626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dc51846c-c229-42d8-8f7b-48342ca9cf6b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:19.554213 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dc51846c-c229-42d8-8f7b-48342ca9cf6b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:19.613630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-dc51846c-c229-42d8-8f7b-48342ca9cf6b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:19.622382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dc51846c-c229-42d8-8f7b-48342ca9cf6b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1214 microversion: 2.1 time: 0.076549 Aug 05 05:58:19.622948 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 951/1881] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:19 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:20.644667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:20.645310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:20.652023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:20.652512 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:20.652926 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:20.653667 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:20.654097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:20.654544 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:20.757230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:20.766278 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-648feec1-709f-4812-83e8-5132d613ea6e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1274 microversion: 2.1 time: 0.126098 Aug 05 05:58:20.766933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 931/1882] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:20 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:21.787844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:21.788549 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:21.795100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:21.795578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:21.796042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:21.796731 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:21.797185 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:21.797604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:21.994246 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:22.004347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-97ff9119-fc58-4647-a199-bf1abff563e5 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1314 microversion: 2.1 time: 0.220443 Aug 05 05:58:22.017698 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 952/1883] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:21 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:22.075896 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-b226813c-667c-4564-a9a6-607d8e776dea req-8551ef10-1135-410c-87a8-17623a6bca7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4beeba77-77d6-4b73-b53e-749bd4e17354", "tag": "c264c810-0451-463e-b091-cdd3de297dd4"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:22.089624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b226813c-667c-4564-a9a6-607d8e776dea req-8551ef10-1135-410c-87a8-17623a6bca7e service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:22.090482 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b226813c-667c-4564-a9a6-607d8e776dea req-8551ef10-1135-410c-87a8-17623a6bca7e service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:22.091019 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b226813c-667c-4564-a9a6-607d8e776dea req-8551ef10-1135-410c-87a8-17623a6bca7e service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:22.103908 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-b226813c-667c-4564-a9a6-607d8e776dea req-8551ef10-1135-410c-87a8-17623a6bca7e service nova] Creating event network-changed:c264c810-0451-463e-b091-cdd3de297dd4 for instance 4beeba77-77d6-4b73-b53e-749bd4e17354 on hv-cinder-81558 Aug 05 05:58:22.109184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-b226813c-667c-4564-a9a6-607d8e776dea req-8551ef10-1135-410c-87a8-17623a6bca7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037117 Aug 05 05:58:22.109927 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 932/1884] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:58:23.025453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:23.026100 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:23.033308 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:23.033810 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:23.034262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:23.034998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:23.035468 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:23.035957 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:23.170891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:23.178816 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-b619b345-072e-4cc6-904c-509d7258880c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1314 microversion: 2.1 time: 0.157610 Aug 05 05:58:23.179389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 953/1885] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:23 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:24.201224 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:24.201932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:24.208288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:24.208774 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:24.209207 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:24.209899 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:24.210352 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:24.210777 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:24.343662 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:24.351354 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c4a00f69-e911-43d0-8eab-97d046801ead tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1314 microversion: 2.1 time: 0.155028 Aug 05 05:58:24.351921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 933/1886] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:24 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:25.377192 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:25.378031 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:25.388965 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:25.389751 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:25.390458 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:25.391626 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:25.392399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:25.393098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:25.535127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:25.542895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c773a1a4-6e3d-4013-a17f-79d294f529bf tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1314 microversion: 2.1 time: 0.173037 Aug 05 05:58:25.543472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 954/1887] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:25 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:25.728511 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-d90687fc-c379-42d1-bc6e-a7fcc8b6ac86 req-5954316b-392f-46b1-89b5-5ae73894e5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4beeba77-77d6-4b73-b53e-749bd4e17354", "name": "network-vif-plugged", "status": "completed", "tag": "c264c810-0451-463e-b091-cdd3de297dd4"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:25.738033 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d90687fc-c379-42d1-bc6e-a7fcc8b6ac86 req-5954316b-392f-46b1-89b5-5ae73894e5bb service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:25.738499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d90687fc-c379-42d1-bc6e-a7fcc8b6ac86 req-5954316b-392f-46b1-89b5-5ae73894e5bb service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:25.738918 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-d90687fc-c379-42d1-bc6e-a7fcc8b6ac86 req-5954316b-392f-46b1-89b5-5ae73894e5bb service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:25.749901 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-d90687fc-c379-42d1-bc6e-a7fcc8b6ac86 req-5954316b-392f-46b1-89b5-5ae73894e5bb service nova] Creating event network-vif-plugged:c264c810-0451-463e-b091-cdd3de297dd4 for instance 4beeba77-77d6-4b73-b53e-749bd4e17354 on hv-cinder-81558 Aug 05 05:58:25.755994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-d90687fc-c379-42d1-bc6e-a7fcc8b6ac86 req-5954316b-392f-46b1-89b5-5ae73894e5bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147825 Aug 05 05:58:25.756739 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 934/1888] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:58:26.568608 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:26.569472 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:26.578818 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:26.579299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:26.579732 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:26.580456 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:26.581016 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:26.581443 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:26.722128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:26.732110 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a7ad2880-0413-4f70-afeb-ee59ed537513 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1314 microversion: 2.1 time: 0.170261 Aug 05 05:58:26.732675 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 955/1889] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:26 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:27.761446 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:27.762228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:27.772875 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:27.773567 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:27.774203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:27.775277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:27.776065 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:27.776684 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:27.917198 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:27.925309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e278b7a1-0661-47aa-9546-f93e6b68ed6c tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1498 microversion: 2.1 time: 0.174116 Aug 05 05:58:27.925897 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 935/1890] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:27 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:28.469166 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:28.469645 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:28.476169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:28.476648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:28.477081 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:28.477762 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:28.478208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:28.478627 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:28.503418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:58:28.591029 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-69358fbe-6590-46e8-b113-e8c7fdc190c6 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 204 len: 0 microversion: 2.1 time: 0.125547 Aug 05 05:58:28.591677 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 956/1891] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:58:28 2022] DELETE /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:58:28.601553 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:28.602160 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:28.608481 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:28.608961 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:28.609387 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:28.610069 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:28.610508 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:28.610921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:28.748135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:28.756748 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-cbaf4b32-14d0-419e-bf55-08f238156184 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1504 microversion: 2.1 time: 0.160076 Aug 05 05:58:28.757311 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 936/1892] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:28 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:58:29.782861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:29.783559 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:29.786113 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:29.792146 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:29.792663 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:29.793087 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:29.794109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:29.794552 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:29.794967 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:29.933329 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:29.941383 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-997ab7cc-2fcc-421b-b083-7f737c60469d tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1504 microversion: 2.1 time: 0.165688 Aug 05 05:58:29.941953 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 957/1893] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:29 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:30.533421 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-fb658b20-fb86-4a28-8bcb-da6e47327f8c req-ed54ad25-cd39-42fa-a09d-0454141d3191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4beeba77-77d6-4b73-b53e-749bd4e17354", "name": "network-vif-deleted", "tag": "c264c810-0451-463e-b091-cdd3de297dd4"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:30.539445 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:30.540268 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:30.544945 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-fb658b20-fb86-4a28-8bcb-da6e47327f8c req-ed54ad25-cd39-42fa-a09d-0454141d3191 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:30.545425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-fb658b20-fb86-4a28-8bcb-da6e47327f8c req-ed54ad25-cd39-42fa-a09d-0454141d3191 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:30.545923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-fb658b20-fb86-4a28-8bcb-da6e47327f8c req-ed54ad25-cd39-42fa-a09d-0454141d3191 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:30.559116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-fb658b20-fb86-4a28-8bcb-da6e47327f8c req-ed54ad25-cd39-42fa-a09d-0454141d3191 service nova] Creating event network-vif-deleted:c264c810-0451-463e-b091-cdd3de297dd4 for instance 4beeba77-77d6-4b73-b53e-749bd4e17354 on hv-cinder-81558 Aug 05 05:58:30.565024 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-fb658b20-fb86-4a28-8bcb-da6e47327f8c req-ed54ad25-cd39-42fa-a09d-0454141d3191 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035317 Aug 05 05:58:30.565690 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 937/1894] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 05:58:30.962312 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:30.963026 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:30.969557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:30.970042 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:30.970474 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:30.971154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:30.971612 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:30.972057 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:31.004536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:31.004992 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:31.005611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:31.006085 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lazy-loading 'fault' on Instance uuid 4beeba77-77d6-4b73-b53e-749bd4e17354 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:58:31.052128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:31.060019 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-6867519b-e078-4425-823f-cd0f7e20a8ec tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 200 len: 1304 microversion: 2.1 time: 0.101633 Aug 05 05:58:31.060618 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 958/1895] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:30 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:32.087427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:32.089182 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: 4beeba77-77d6-4b73-b53e-749bd4e17354] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:32.098473 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:32.098992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:32.099424 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:32.100157 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:32.100597 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:32.101014 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:32.116570 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] HTTP exception thrown: Instance 4beeba77-77d6-4b73-b53e-749bd4e17354 could not be found. Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Request method failure captured: Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 HTTP/1.1 Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7LF5o1gT4DLZ5MB6GPqQFhPqZCdQKOdbgXVc0GPax9tdEyfVu7_c4BoH_Tcc9gdIq3h_LPjo3J_VHMCNlzD_VGtA6DfPmo4BpKXVsMuJI5_0EAGzkx6daGFlIhoEmTKpe8CeZRz8wuoodS9brjI8dS0IuObSVWTHqEZVO4NaMG5NTk4 Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: d9c62c503f4844babfd2528fa8c0722f Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesActionsTest-725058546 Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:58:32.118190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9c62c503f4844babfd2528fa8c0722f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9c62c503f4844babfd2528fa8c0722f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9c62c503f4844babfd2528fa8c0722f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9c62c503f4844babfd2528fa8c0722f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesActionsTest-725058546 Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: d9c62c503f4844babfd2528fa8c0722f Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesActionsTest-725058546 Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesActionsTest-725058546-project Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 947f7daa83a94adbad8ef6d4a737eccf Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesActionsTest-725058546-project Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance 4beeba77-77d6-4b73-b53e-749bd4e17354 could not be found. Aug 05 05:58:32.119560 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': '4beeba77-77d6-4b73-b53e-749bd4e17354'} Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4beeba77-77d6-4b73-b53e-749bd4e17354 could not be found. Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:32.120390 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4beeba77-77d6-4b73-b53e-749bd4e17354 could not be found. Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4beeba77-77d6-4b73-b53e-749bd4e17354 could not be found. Aug 05 05:58:32.121582 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:32.123200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Returning 404 to user: Instance 4beeba77-77d6-4b73-b53e-749bd4e17354 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:32.123200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-4dc5a903-ed5c-40d7-b3f4-4f1a1057d003 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354" status: 404 len: 111 microversion: 2.1 time: 0.040195 Aug 05 05:58:32.123200 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 938/1896] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:32 2022] GET /compute/v2.1/servers/4beeba77-77d6-4b73-b53e-749bd4e17354 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:58:32.172850 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-41317207", "imageRef": "5b01d736-7383-4607-ad59-37bc6b433b1d", "flavorRef": "452", "networks": [{"uuid": "016676d6-00c7-42a2-b42f-8a1c9e230620"}]}} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:32.229838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.network.neutron [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] validate_networks() for [('016676d6-00c7-42a2-b42f-8a1c9e230620', None, None, None, None, None)] {{(pid=117902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:58:32.637462 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Flavor limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:58:32.638088 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Image limits 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:58:32.638763 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Flavor pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:58:32.639339 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Image pref 0:0:0 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:58:32.639995 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.virt.hardware [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:58:32.654064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:32.654716 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:32.655324 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:32.656485 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:32.657134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:32.657676 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:32.675189 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Getting quotas for project d9c62c503f4844babfd2528fa8c0722f. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:58:32.679252 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.quota [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Getting quotas for user 947f7daa83a94adbad8ef6d4a737eccf and project d9c62c503f4844babfd2528fa8c0722f. Resources: {'instances', 'cores', 'ram'} {{(pid=117902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:58:32.690372 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Going to run 1 instances... {{(pid=117902) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:58:32.692685 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b01d736-7383-4607-ad59-37bc6b433b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:58:32.738182 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-7063fe87-2555-4c2e-89a1-819e67525c46 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569237 Aug 05 05:58:32.738800 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 959/1897] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:58:32.750241 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-d781bc1d-e34f-4d8a-8cdc-a2d7b135fb09 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:32.750851 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-d781bc1d-e34f-4d8a-8cdc-a2d7b135fb09 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:32.804784 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-d781bc1d-e34f-4d8a-8cdc-a2d7b135fb09 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:32.812121 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-d781bc1d-e34f-4d8a-8cdc-a2d7b135fb09 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1212 microversion: 2.1 time: 0.066153 Aug 05 05:58:32.812686 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 939/1898] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:32 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1212 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:33.834511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:33.836058 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:33.846241 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:33.846768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:33.847419 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:33.848150 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:33.848571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:33.849307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:33.943342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:33.951020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-4e491a25-9574-41fd-8d6c-19cd0befdaaa tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1270 microversion: 2.1 time: 0.121396 Aug 05 05:58:33.951587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 960/1899] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:33 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:34.972743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:34.973343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:34.981671 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:34.982216 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:34.982639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:34.983320 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:34.984112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:34.984522 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:35.173547 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:35.181257 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-52490726-b8e6-485c-b9ce-4a2188c86980 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1312 microversion: 2.1 time: 0.212915 Aug 05 05:58:35.181857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 940/1900] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:34 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:35.397860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-9e0bfccf-9d38-4c08-94c0-64b42dfc3210 req-8e12bc73-919b-4142-abd7-2cc72ffb45e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbff79c3-ec48-493b-a629-aa45019bc3c6", "tag": "e9519552-ccb3-442b-8600-26ef0a20d841"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:35.409128 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9e0bfccf-9d38-4c08-94c0-64b42dfc3210 req-8e12bc73-919b-4142-abd7-2cc72ffb45e7 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:35.409683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9e0bfccf-9d38-4c08-94c0-64b42dfc3210 req-8e12bc73-919b-4142-abd7-2cc72ffb45e7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:35.410210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-9e0bfccf-9d38-4c08-94c0-64b42dfc3210 req-8e12bc73-919b-4142-abd7-2cc72ffb45e7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:35.421501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-9e0bfccf-9d38-4c08-94c0-64b42dfc3210 req-8e12bc73-919b-4142-abd7-2cc72ffb45e7 service nova] Creating event network-changed:e9519552-ccb3-442b-8600-26ef0a20d841 for instance fbff79c3-ec48-493b-a629-aa45019bc3c6 on hv-cinder-81558 Aug 05 05:58:35.426425 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-9e0bfccf-9d38-4c08-94c0-64b42dfc3210 req-8e12bc73-919b-4142-abd7-2cc72ffb45e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038506 Aug 05 05:58:35.427027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 961/1901] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:58:36.206192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:36.207229 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:36.218275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:36.219074 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:36.219831 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:36.220973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:36.221734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:36.222150 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:36.363489 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:36.371381 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-0ed3682a-9a4d-47f0-9386-009a89cc686a tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1312 microversion: 2.1 time: 0.171836 Aug 05 05:58:36.371980 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 941/1902] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:36 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:37.394299 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:37.394897 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:37.401888 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:37.402392 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:37.402847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:37.403563 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:37.404064 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:37.404505 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:37.537365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:37.544985 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-a3933ffc-bf7f-478f-a3ad-970ee57d7bab tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1312 microversion: 2.1 time: 0.155912 Aug 05 05:58:37.545591 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 962/1903] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:37 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:38.570218 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:38.571045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:38.581906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:38.582701 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:38.583416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:38.584617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:38.585363 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:38.586058 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:38.731103 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:38.739349 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1c57c854-b674-4f8a-8250-3a64594b5c63 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1312 microversion: 2.1 time: 0.176286 Aug 05 05:58:38.739923 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 942/1904] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:38 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:39.663758 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-03c6e14b-3803-4ac1-8949-9471c48a8dce req-7dc692bf-a161-45e2-97b8-e9e8c6d12de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbff79c3-ec48-493b-a629-aa45019bc3c6", "name": "network-vif-plugged", "status": "completed", "tag": "e9519552-ccb3-442b-8600-26ef0a20d841"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:39.674749 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-03c6e14b-3803-4ac1-8949-9471c48a8dce req-7dc692bf-a161-45e2-97b8-e9e8c6d12de4 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:39.675315 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-03c6e14b-3803-4ac1-8949-9471c48a8dce req-7dc692bf-a161-45e2-97b8-e9e8c6d12de4 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:39.675846 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-03c6e14b-3803-4ac1-8949-9471c48a8dce req-7dc692bf-a161-45e2-97b8-e9e8c6d12de4 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:39.687441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-03c6e14b-3803-4ac1-8949-9471c48a8dce req-7dc692bf-a161-45e2-97b8-e9e8c6d12de4 service nova] Creating event network-vif-plugged:e9519552-ccb3-442b-8600-26ef0a20d841 for instance fbff79c3-ec48-493b-a629-aa45019bc3c6 on hv-cinder-81558 Aug 05 05:58:39.692578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-03c6e14b-3803-4ac1-8949-9471c48a8dce req-7dc692bf-a161-45e2-97b8-e9e8c6d12de4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032673 Aug 05 05:58:39.693181 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 963/1905] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:58:39.761921 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:39.762428 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:39.769005 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:39.772147 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:39.772621 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:39.773326 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:39.773782 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:39.774203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:39.934067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:39.941836 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8f58df29-3329-4af5-91a6-3ebd365f7893 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1312 microversion: 2.1 time: 0.184324 Aug 05 05:58:39.942403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 943/1906] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:39 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:40.968415 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:40.969593 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:40.980838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:40.981625 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:40.982357 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:40.983504 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:40.984292 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:40.985027 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:41.131067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:41.140904 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-36801950-3ea4-4e1c-b87c-5a45f64f6a91 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1312 microversion: 2.1 time: 0.180329 Aug 05 05:58:41.141705 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 964/1907] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:40 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:42.163558 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:42.164203 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:42.170922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:42.171401 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:42.171867 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:42.172550 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:42.172986 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:42.173399 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:42.310425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:42.321299 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c4677603-04f0-4e38-a17a-bf2d7d5787bd tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1496 microversion: 2.1 time: 0.161396 Aug 05 05:58:42.322040 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 944/1908] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:42 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:42.861098 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:42.861601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:42.864194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:42.864860 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=6 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:42.870844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:42.871330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:42.871759 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:42.872470 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:42.872925 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:42.873334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:42.898385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:58:42.981405 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-867eec1e-e27b-4432-af63-42e5450d8368 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 204 len: 0 microversion: 2.1 time: 0.124223 Aug 05 05:58:42.985099 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 965/1909] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:58:42 2022] DELETE /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:58:42.990379 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:42.990994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:42.993059 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:42.998596 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:42.999078 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:43.000427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:43.000603 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:43.001053 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:43.001464 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:43.138171 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:43.146155 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f908a970-8911-496c-b8ca-f6e43161b15b tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1502 microversion: 2.1 time: 0.159601 Aug 05 05:58:43.146728 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 945/1910] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:42 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:44.169880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:44.170556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:44.177711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:44.178194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:44.178623 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:44.179325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:44.179791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:44.180227 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:44.315712 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:44.319316 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:44.324127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-394f0da7-3c2a-4974-846e-bd0a003a0a8e tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1502 microversion: 2.1 time: 0.159993 Aug 05 05:58:44.324695 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 966/1911] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:44 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:44.917722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-1a0feb0d-11d8-4a48-8b08-342e803b54c5 req-5e5a2dd4-1622-4a43-b5a2-fca2f0fe1604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbff79c3-ec48-493b-a629-aa45019bc3c6", "name": "network-vif-deleted", "tag": "e9519552-ccb3-442b-8600-26ef0a20d841"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:58:44.932618 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-1a0feb0d-11d8-4a48-8b08-342e803b54c5 req-5e5a2dd4-1622-4a43-b5a2-fca2f0fe1604 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:44.933275 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-1a0feb0d-11d8-4a48-8b08-342e803b54c5 req-5e5a2dd4-1622-4a43-b5a2-fca2f0fe1604 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:44.934542 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-1a0feb0d-11d8-4a48-8b08-342e803b54c5 req-5e5a2dd4-1622-4a43-b5a2-fca2f0fe1604 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:44.946765 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-1a0feb0d-11d8-4a48-8b08-342e803b54c5 req-5e5a2dd4-1622-4a43-b5a2-fca2f0fe1604 service nova] Creating event network-vif-deleted:e9519552-ccb3-442b-8600-26ef0a20d841 for instance fbff79c3-ec48-493b-a629-aa45019bc3c6 on hv-cinder-81558 Aug 05 05:58:44.953749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-1a0feb0d-11d8-4a48-8b08-342e803b54c5 req-5e5a2dd4-1622-4a43-b5a2-fca2f0fe1604 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039481 Aug 05 05:58:44.954548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 946/1912] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:58:45.345313 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:45.346013 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:45.354601 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:45.355169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:45.355607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:45.356332 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:45.356780 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:45.357198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:45.390945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:45.391444 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:45.391895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:45.392340 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.objects.instance [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lazy-loading 'fault' on Instance uuid fbff79c3-ec48-493b-a629-aa45019bc3c6 {{(pid=117902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:58:45.435844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f7daa83a94adbad8ef6d4a737eccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9c62c503f4844babfd2528fa8c0722f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:45.443622 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2a48734b-7871-4439-998d-588eb9eff491 tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 200 len: 1302 microversion: 2.1 time: 0.102219 Aug 05 05:58:45.444268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 967/1913] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:45 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:58:46.470459 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:46.471305 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] [instance: fbff79c3-ec48-493b-a629-aa45019bc3c6] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:46.481418 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:46.481992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:46.482612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:46.483634 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:46.484217 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:46.484771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:46.499187 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] HTTP exception thrown: Instance fbff79c3-ec48-493b-a629-aa45019bc3c6 could not be found. Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Request method failure captured: Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 HTTP/1.1 Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7LF5o1gT4DLZ5MB6GPqQFhPqZCdQKOdbgXVc0GPax9tdEyfVu7_c4BoH_Tcc9gdIq3h_LPjo3J_VHMCNlzD_VGtA6DfPmo4BpKXVsMuJI5_0EAGzkx6daGFlIhoEmTKpe8CeZRz8wuoodS9brjI8dS0IuObSVWTHqEZVO4NaMG5NTk4 Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: d9c62c503f4844babfd2528fa8c0722f Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-VolumesActionsTest-725058546 Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 05:58:46.501211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9c62c503f4844babfd2528fa8c0722f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9c62c503f4844babfd2528fa8c0722f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9c62c503f4844babfd2528fa8c0722f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9c62c503f4844babfd2528fa8c0722f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-VolumesActionsTest-725058546 Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: d9c62c503f4844babfd2528fa8c0722f Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-VolumesActionsTest-725058546 Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-VolumesActionsTest-725058546-project Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 947f7daa83a94adbad8ef6d4a737eccf Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-VolumesActionsTest-725058546-project Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance fbff79c3-ec48-493b-a629-aa45019bc3c6 could not be found. Aug 05 05:58:46.502510 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'fbff79c3-ec48-493b-a629-aa45019bc3c6'} Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbff79c3-ec48-493b-a629-aa45019bc3c6 could not be found. Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:58:46.503321 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbff79c3-ec48-493b-a629-aa45019bc3c6 could not be found. Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbff79c3-ec48-493b-a629-aa45019bc3c6 could not be found. Aug 05 05:58:46.504743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 05:58:46.505967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] Returning 404 to user: Instance fbff79c3-ec48-493b-a629-aa45019bc3c6 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:58:46.505967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-79a13656-db28-40bf-a487-ad11293dafda tempest-VolumesActionsTest-725058546 tempest-VolumesActionsTest-725058546-project] 10.222.0.30 "GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6" status: 404 len: 111 microversion: 2.1 time: 0.039391 Aug 05 05:58:46.505967 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 947/1914] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:46 2022] GET /compute/v2.1/servers/fbff79c3-ec48-493b-a629-aa45019bc3c6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:58:58.083368 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:58.083996 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:58.086718 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:58.087509 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=8 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:58.095667 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:58.096233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:58.096947 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:58.097701 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:58.098160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:58.098739 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:58.128481 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 05:58:58.227573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9f96d2f7-d525-4d64-acf3-505e81c2c4ae tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 204 len: 0 microversion: 2.1 time: 0.150027 Aug 05 05:58:58.231861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 968/1915] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 05:58:58 2022] DELETE /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 05:58:58.240105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:58.241323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:58.246279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:58.251695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=74 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:58:58.262149 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:58.262796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:58.263416 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:58.264433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:58.265056 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:58.265639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:58.430109 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:58.440281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-e3177774-6a3a-4418-bd5d-dfcac659ff85 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1577 microversion: 2.1 time: 0.207003 Aug 05 05:58:58.456657 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 948/1916] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:58 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:58:59.470048 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:58:59.472382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:58:59.484233 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:59.485501 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:59.486370 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:59.487791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:58:59.489053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:58:59.490382 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:58:59.693071 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:58:59.701872 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bf1f2869-0b4f-4a86-9cfb-40181b6f3e3b tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1577 microversion: 2.1 time: 0.239619 Aug 05 05:58:59.702457 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 969/1917] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:58:59 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:00.722903 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:00.724230 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:00.731552 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:00.732389 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:00.733088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:00.734060 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:00.734731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:00.735382 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:00.831403 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:00.841524 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-13996387-f3e8-42e9-9318-ad01f47df941 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1510 microversion: 2.1 time: 0.122617 Aug 05 05:59:00.857799 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 949/1918] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:00 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1510 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:01.047582 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-1d2a916b-1e6f-44a0-b10d-592daf3b90ce req-e4d876ab-35d0-4990-a6fb-a63c9db6e0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cc6fea-ff45-4fab-80eb-202ca0225928", "name": "network-vif-deleted", "tag": "ae8bf989-e35a-4964-9a86-c04cd9b5bddb"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:59:01.059692 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1d2a916b-1e6f-44a0-b10d-592daf3b90ce req-e4d876ab-35d0-4990-a6fb-a63c9db6e0e9 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:01.064791 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1d2a916b-1e6f-44a0-b10d-592daf3b90ce req-e4d876ab-35d0-4990-a6fb-a63c9db6e0e9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:01.066169 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-1d2a916b-1e6f-44a0-b10d-592daf3b90ce req-e4d876ab-35d0-4990-a6fb-a63c9db6e0e9 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:01.081840 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-1d2a916b-1e6f-44a0-b10d-592daf3b90ce req-e4d876ab-35d0-4990-a6fb-a63c9db6e0e9 service nova] Creating event network-vif-deleted:ae8bf989-e35a-4964-9a86-c04cd9b5bddb for instance a8cc6fea-ff45-4fab-80eb-202ca0225928 on hv-cinder-81558 Aug 05 05:59:01.099882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-1d2a916b-1e6f-44a0-b10d-592daf3b90ce req-e4d876ab-35d0-4990-a6fb-a63c9db6e0e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055809 Aug 05 05:59:01.100508 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 970/1919] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:59:01.864449 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:01.865223 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:01.879534 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:01.880913 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:01.881372 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:01.882247 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:01.882689 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:01.883565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:01.921870 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:01.922731 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:01.923330 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:01.923946 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.objects.instance [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lazy-loading 'fault' on Instance uuid a8cc6fea-ff45-4fab-80eb-202ca0225928 {{(pid=117903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 05:59:01.987756 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:01.997789 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-bae3a2b1-7640-4d52-9a2b-fcf483b94304 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 200 len: 1184 microversion: 2.1 time: 0.137113 Aug 05 05:59:02.019386 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 950/1920] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:01 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 1184 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:03.027861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:03.028738 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:03.039267 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:03.040307 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:03.040839 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:03.041868 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:03.042420 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:03.042838 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:03.059599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] HTTP exception thrown: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Request method failure captured: Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 HTTP/1.1 Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LEIMjOnWdn5eE5XLYFr8n9Ky4No9wEXREj9Nn36Uka_gq5eOtL088TPGQ9IQ-MTTyBsgyKDb7v6Rv5kxRaj2TlKugeyOpVZSJoZ7jHfe_gduwNOBYG3wbzddF1m0LIsueoyTnG-Mj0r-WzxHljoMTDssAum7euxT6VqWKLZsjHBx_A Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 05:59:03.061665 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d93689b1aaa347368f1f590eb6b494cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-TestVolumeBootPattern-490682024 Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-TestVolumeBootPattern-490682024-project Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 4f727e9d632e4592b82ebd1f00cdf8df Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-TestVolumeBootPattern-490682024-project Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 05:59:03.063127 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'a8cc6fea-ff45-4fab-80eb-202ca0225928'} Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 05:59:03.064025 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 05:59:03.065587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 05:59:03.067294 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Returning 404 to user: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 05:59:03.068603 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-010e6851-667d-461d-8b33-c1f7b31f702d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 404 len: 111 microversion: 2.1 time: 0.045076 Aug 05 05:59:03.069681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 971/1921] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:03 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 05:59:03.187467 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1367788830", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1947595121", "security_groups": [{"name": "tempest-secgroup-smoke-330230172"}], "block_device_mapping_v2": [{"uuid": "e53214bc-96df-49c2-86bc-f5f2abb5c975", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7420a8bf-5805-4b36-aff6-79e0ea4322eb"}]}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:59:03.318096 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] validate_networks() for [('7420a8bf-5805-4b36-aff6-79e0ea4322eb', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 05:59:03.740348 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 05:59:03.740951 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 05:59:03.741591 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 05:59:03.742163 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 05:59:03.742734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 05:59:03.753048 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:03.753529 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:03.753956 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:03.754709 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:03.755306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:03.755757 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:03.774192 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for project d93689b1aaa347368f1f590eb6b494cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 05:59:03.778847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for user 4f727e9d632e4592b82ebd1f00cdf8df and project d93689b1aaa347368f1f590eb6b494cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 05:59:03.847063 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 05:59:03.849235 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e53214bc-96df-49c2-86bc-f5f2abb5c975',volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 05:59:04.002922 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1bd84142-c2ce-4bbc-89a5-6c410aa2881f tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.819276 Aug 05 05:59:04.009604 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 951/1922] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 05:59:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 05:59:04.027208 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-36f74f89-9a59-4389-a1d5-9d8a41d1e062 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:04.028053 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-36f74f89-9a59-4389-a1d5-9d8a41d1e062 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:04.093938 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-36f74f89-9a59-4389-a1d5-9d8a41d1e062 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:04.104196 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-36f74f89-9a59-4389-a1d5-9d8a41d1e062 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1095 microversion: 2.1 time: 0.082109 Aug 05 05:59:04.105771 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 972/1923] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:04 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:05.130750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:05.131840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:05.149670 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:05.150744 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:05.151343 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:05.152272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:05.153042 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:05.153568 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:05.283385 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:05.293133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9546045e-498e-41d2-ac74-f71990b3ef11 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1201 microversion: 2.1 time: 0.168774 Aug 05 05:59:05.293704 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 952/1924] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:05 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1201 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:06.313187 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:06.313811 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:06.321478 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:06.322209 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:06.322861 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:06.323891 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:06.324588 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:06.325287 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:06.600076 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:06.608484 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-9b5695c0-2915-428a-be8c-5e8a0a37aee1 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.299262 Aug 05 05:59:06.609195 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 973/1925] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:06 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 05:59:06.738167 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-bfc05f0c-07a4-4657-9b12-a3c47471c9f7 req-45e15b59-1b89-4b1b-bd96-2962d97c7d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db34ac0-8485-4b5c-93c0-a19ed842cfe1", "tag": "e247070a-eb79-4d63-a455-8dd9b72e6ea8"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:59:06.748374 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bfc05f0c-07a4-4657-9b12-a3c47471c9f7 req-45e15b59-1b89-4b1b-bd96-2962d97c7d88 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:06.749266 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bfc05f0c-07a4-4657-9b12-a3c47471c9f7 req-45e15b59-1b89-4b1b-bd96-2962d97c7d88 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:06.749775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-bfc05f0c-07a4-4657-9b12-a3c47471c9f7 req-45e15b59-1b89-4b1b-bd96-2962d97c7d88 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:06.761857 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-bfc05f0c-07a4-4657-9b12-a3c47471c9f7 req-45e15b59-1b89-4b1b-bd96-2962d97c7d88 service nova] Creating event network-changed:e247070a-eb79-4d63-a455-8dd9b72e6ea8 for instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 on hv-cinder-81558 Aug 05 05:59:06.767131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-bfc05f0c-07a4-4657-9b12-a3c47471c9f7 req-45e15b59-1b89-4b1b-bd96-2962d97c7d88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032894 Aug 05 05:59:06.767756 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 953/1926] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:59:07.630824 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:07.631647 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:07.637681 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:07.638159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:07.638882 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:07.639571 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:07.640052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:07.640460 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:07.780106 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:07.788197 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-2c6d7236-639d-481c-a869-023ca34cf476 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.161795 Aug 05 05:59:07.788817 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 974/1927] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:07 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:08.810290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:08.811589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:08.817940 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:08.818431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:08.818829 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:08.819549 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:08.820027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:08.820525 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:09.053617 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:09.062468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ad0ba0fb-cd34-4e17-87aa-3d5554737ca5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.256936 Aug 05 05:59:09.067795 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 954/1928] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:08 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:10.087506 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:10.088573 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:10.098777 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:10.099262 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:10.099683 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:10.100402 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:10.100865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:10.101261 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:10.240652 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:10.250980 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-08640ae9-ed5c-415d-a537-06f89bc49190 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.170071 Aug 05 05:59:10.251886 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 975/1929] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:10 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:11.276323 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:11.277139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:11.286639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:11.287127 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:11.287561 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:11.288303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:11.288749 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:11.289174 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:11.420727 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:11.432566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6640f089-4588-48bf-8323-44ab29829330 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.162711 Aug 05 05:59:11.433322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 955/1930] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:11 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:12.460395 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:12.461404 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:12.472336 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:12.473134 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:12.473865 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:12.474998 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:12.475745 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:12.476507 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:12.614034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:12.621710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-667b52a4-280b-40e4-a2e1-447e4ad0a4fb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.168081 Aug 05 05:59:12.622250 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 976/1931] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:12 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:13.646840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:13.647847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:13.658977 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:13.659496 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:13.659973 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:13.660665 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:13.661116 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:13.661536 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:13.765891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:59:13.787548 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:59:13.809839 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:13.817705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-1adc288c-0942-4273-ab50-963dbdfb3839 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.177582 Aug 05 05:59:13.818310 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 956/1932] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:13 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:14.839215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:14.839858 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:14.842320 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 05:59:14.849943 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:14.850617 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:14.851215 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:14.852268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:14.852973 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:14.853635 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:14.988325 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:14.996033 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-3ffb1772-d748-4e8d-b924-0c71ea39747d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.160986 Aug 05 05:59:14.996578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 977/1933] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:14 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:16.021288 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:16.022298 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:16.033280 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:16.034133 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:16.034565 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:16.035248 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:16.035695 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:16.036131 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:16.185272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:16.197713 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a3161aa0-f437-451e-a922-91f791a2b307 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.182854 Aug 05 05:59:16.198376 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 957/1934] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:16 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:16.465798 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-a034eff4-4d10-4abd-96df-be7e60a61e1a req-f1e5d64c-8842-4b21-b47e-1e10015eb0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db34ac0-8485-4b5c-93c0-a19ed842cfe1", "name": "network-vif-plugged", "status": "completed", "tag": "e247070a-eb79-4d63-a455-8dd9b72e6ea8"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:59:16.476684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-a034eff4-4d10-4abd-96df-be7e60a61e1a req-f1e5d64c-8842-4b21-b47e-1e10015eb0d0 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:16.477163 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-a034eff4-4d10-4abd-96df-be7e60a61e1a req-f1e5d64c-8842-4b21-b47e-1e10015eb0d0 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:16.477587 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-a034eff4-4d10-4abd-96df-be7e60a61e1a req-f1e5d64c-8842-4b21-b47e-1e10015eb0d0 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:16.489802 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-a034eff4-4d10-4abd-96df-be7e60a61e1a req-f1e5d64c-8842-4b21-b47e-1e10015eb0d0 service nova] Creating event network-vif-plugged:e247070a-eb79-4d63-a455-8dd9b72e6ea8 for instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 on hv-cinder-81558 Aug 05 05:59:16.494699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-a034eff4-4d10-4abd-96df-be7e60a61e1a req-f1e5d64c-8842-4b21-b47e-1e10015eb0d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 Aug 05 05:59:16.495301 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 978/1935] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 05:59:17.224891 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:17.225882 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:17.236640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:17.237322 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:17.237742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:17.238425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:17.238868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:17.239279 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:17.381172 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:17.389290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-ea359c8a-e98a-4707-a849-e3b8dbeb4ef9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1266 microversion: 2.1 time: 0.170741 Aug 05 05:59:17.390484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 958/1936] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:17 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:18.416696 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:18.417845 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:18.427436 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:18.427961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:18.428399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:18.429089 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:18.429536 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:18.429959 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:18.571103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:18.579245 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-db92a682-7c23-46f0-b8b6-e88cac0f780d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1453 microversion: 2.1 time: 0.170820 Aug 05 05:59:18.579788 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 979/1937] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:18 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:18.599595 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 05:59:18.600277 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 05:59:18.607373 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:18.607991 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:18.608427 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:18.609123 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:18.609581 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:18.610003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:18.745429 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 05:59:18.753786 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-9cd03251-70ec-43f6-857b-d125e08a2418 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1453 microversion: 2.1 time: 0.158154 Aug 05 05:59:18.754396 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 959/1938] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 05:59:18 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 05:59:20.379445 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-e9d1a869-2c9a-4bb2-8a30-dd68685d9c1c req-0b0c25f8-b4cc-45f6-a3bc-094d117f006d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db34ac0-8485-4b5c-93c0-a19ed842cfe1", "tag": "e247070a-eb79-4d63-a455-8dd9b72e6ea8"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 05:59:20.389599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e9d1a869-2c9a-4bb2-8a30-dd68685d9c1c req-0b0c25f8-b4cc-45f6-a3bc-094d117f006d service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 05:59:20.390056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e9d1a869-2c9a-4bb2-8a30-dd68685d9c1c req-0b0c25f8-b4cc-45f6-a3bc-094d117f006d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 05:59:20.390607 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-e9d1a869-2c9a-4bb2-8a30-dd68685d9c1c req-0b0c25f8-b4cc-45f6-a3bc-094d117f006d service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 05:59:20.401770 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-e9d1a869-2c9a-4bb2-8a30-dd68685d9c1c req-0b0c25f8-b4cc-45f6-a3bc-094d117f006d service nova] Creating event network-changed:e247070a-eb79-4d63-a455-8dd9b72e6ea8 for instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 on hv-cinder-81558 Aug 05 05:59:20.406744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-e9d1a869-2c9a-4bb2-8a30-dd68685d9c1c req-0b0c25f8-b4cc-45f6-a3bc-094d117f006d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031293 Aug 05 05:59:20.407399 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 980/1939] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 05:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:00:54.596817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 06:00:54.597637 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:00:54.598627 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=66 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:00:54.603184 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1598439350", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1947595121", "security_groups": [{"name": "tempest-secgroup-smoke-330230172"}], "block_device_mapping_v2": [{"uuid": "66026db8-72da-453b-bc4e-f4283c99a3df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7420a8bf-5805-4b36-aff6-79e0ea4322eb"}]}} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:00:54.721211 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.network.neutron [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] validate_networks() for [('7420a8bf-5805-4b36-aff6-79e0ea4322eb', None, None, None, None, None)] {{(pid=117903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 06:00:55.162847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Flavor limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 06:00:55.163272 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Image limits 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 06:00:55.163747 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Flavor pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 06:00:55.164181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Image pref 0:0:0 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 06:00:55.164589 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.virt.hardware [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 06:00:55.176932 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:55.177410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:55.177840 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:55.178557 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:55.179009 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:55.179425 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:55.196303 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for project d93689b1aaa347368f1f590eb6b494cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 06:00:55.200479 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.quota [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Getting quotas for user 4f727e9d632e4592b82ebd1f00cdf8df and project d93689b1aaa347368f1f590eb6b494cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 06:00:55.268750 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Going to run 1 instances... {{(pid=117903) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 06:00:55.270974 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66026db8-72da-453b-bc4e-f4283c99a3df',volume_size=None,volume_type=None)] {{(pid=117903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 06:00:55.409491 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-373a4a86-57e3-4236-9cca-ce702dff1ae8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.814368 Aug 05 06:00:55.410154 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 960/1940] 10.222.0.30 () {60 vars in 1147 bytes} [Fri Aug 5 06:00:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 06:00:55.419556 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:00:55.420284 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:00:55.424693 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-688a8d6b-a282-4449-8b82-f01cf7bca4d5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:00:55.425396 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-688a8d6b-a282-4449-8b82-f01cf7bca4d5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:00:55.488752 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-688a8d6b-a282-4449-8b82-f01cf7bca4d5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:00:55.496032 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-688a8d6b-a282-4449-8b82-f01cf7bca4d5 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1095 microversion: 2.1 time: 0.078590 Aug 05 06:00:55.497337 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 981/1941] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:00:55 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:00:56.518791 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:00:56.519410 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:00:56.532003 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:56.532499 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:56.533023 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:56.533862 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:56.534353 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:56.534772 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:56.540724 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6328069-5ebe-4010-b751-1f588d9225b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35782. Aug 05 06:00:56.869705 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:00:56.880118 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-c791864e-89a3-47f5-9446-f35781c39017 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1211 microversion: 2.1 time: 0.365954 Aug 05 06:00:56.880895 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 961/1942] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:00:56 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1211 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:00:57.902544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:00:57.903342 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:00:57.912567 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:57.913050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:57.913927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:57.914620 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:57.915067 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:57.915483 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:58.122407 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:00:58.130545 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-38baed39-4661-4f32-8fd0-448347e8e905 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.232867 Aug 05 06:00:58.131124 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 982/1943] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:00:57 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 06:00:58.200992 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-b7b5e0ea-f13e-43b3-95e4-faa275b9e9e6 req-a73f1634-7351-4ccf-9f35-e6c5c33c8f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aaad586-58b7-4331-9139-ec953988ca2e", "tag": "bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:00:58.213306 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b7b5e0ea-f13e-43b3-95e4-faa275b9e9e6 req-a73f1634-7351-4ccf-9f35-e6c5c33c8f04 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:58.214036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b7b5e0ea-f13e-43b3-95e4-faa275b9e9e6 req-a73f1634-7351-4ccf-9f35-e6c5c33c8f04 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:58.214434 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b7b5e0ea-f13e-43b3-95e4-faa275b9e9e6 req-a73f1634-7351-4ccf-9f35-e6c5c33c8f04 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:58.225989 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-b7b5e0ea-f13e-43b3-95e4-faa275b9e9e6 req-a73f1634-7351-4ccf-9f35-e6c5c33c8f04 service nova] Creating event network-changed:bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5 for instance 9aaad586-58b7-4331-9139-ec953988ca2e on hv-cinder-81558 Aug 05 06:00:58.231181 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-b7b5e0ea-f13e-43b3-95e4-faa275b9e9e6 req-a73f1634-7351-4ccf-9f35-e6c5c33c8f04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Aug 05 06:00:58.231952 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 962/1944] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:00:59.150804 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:00:59.151418 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:00:59.158847 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:59.159334 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:59.159945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:59.160653 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:00:59.161103 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:00:59.161525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:00:59.376069 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:00:59.384648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c2db1ffa-255f-48e9-a928-08b5f308c177 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.237811 Aug 05 06:00:59.386544 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 983/1945] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:00:59 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:00.410889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:00.412067 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:00.422437 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:00.423227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:00.423985 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:00.425105 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:00.426044 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:00.426742 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:00.579245 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:00.590722 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-8b368bc9-50dd-46ea-8417-15c7a5cb6c63 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.187837 Aug 05 06:01:00.591432 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 963/1946] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:00 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:01.621521 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:01.622599 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:01.633713 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:01.634569 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:01.635009 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:01.635711 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:01.636203 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:01.636630 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:01.777092 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:01.785123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-356fc959-6405-40e2-9675-e524a297ed27 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.172167 Aug 05 06:01:01.785694 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 984/1947] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:01 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:02.809441 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:02.810190 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:02.818629 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:02.819228 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:02.819810 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:02.820669 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:02.821227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:02.821847 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:02.962227 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:02.970502 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-96bb4fbd-b09d-44d3-87c5-9af7cf4fb810 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.166889 Aug 05 06:01:02.971064 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 964/1948] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:02 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:03.995361 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:03.997637 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:04.008823 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:04.009631 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:04.010349 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:04.011499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:04.012293 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:04.012994 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:04.163880 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:04.175863 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ab5d3270-70f5-4c48-a0a5-55af2a900570 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.186750 Aug 05 06:01:04.176633 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 985/1949] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:03 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:05.201431 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:05.202406 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:05.206476 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=2 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:01:05.209206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell0:SELECT=6 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:01:05.216008 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:05.216817 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:05.217551 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:05.218696 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:05.219478 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:05.220281 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:05.359114 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:05.370452 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f7e1df1b-1dcb-483f-8b61-c071d22b13c3 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.175654 Aug 05 06:01:05.371624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 965/1950] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:05 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:06.400982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:06.401768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:06.404684 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell0:SELECT=2 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:01:06.411268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:06.411874 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:06.412414 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:06.413373 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:06.413877 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:06.414393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:06.553889 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:06.561876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-f14ca340-b6bc-4805-915f-eeee9b7426cf tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.167399 Aug 05 06:01:06.562427 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 986/1951] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:06 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:07.582395 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:07.583029 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:07.589576 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:07.590282 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:07.590716 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:07.591368 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:07.591868 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:07.592283 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:07.725858 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:07.734045 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-a6cf5c6e-d9a2-4f99-9c75-98235fdad130 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.155587 Aug 05 06:01:07.734601 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 966/1952] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:07 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:08.759109 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:08.760205 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:08.770605 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:08.771447 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:08.772242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:08.773377 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:08.774126 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:08.774895 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:08.914706 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:08.926183 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-16f4246f-9eb1-4a57-901f-1b2fc9c60785 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.173226 Aug 05 06:01:08.927034 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 987/1953] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:08 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:09.019422 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-85d1c4c2-4f60-489b-9489-0d390df4c311 req-244b56aa-cd7d-4ac9-b003-af22a85fc6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aaad586-58b7-4331-9139-ec953988ca2e", "name": "network-vif-plugged", "status": "completed", "tag": "bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:01:09.031880 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-85d1c4c2-4f60-489b-9489-0d390df4c311 req-244b56aa-cd7d-4ac9-b003-af22a85fc6b7 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:09.032647 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-85d1c4c2-4f60-489b-9489-0d390df4c311 req-244b56aa-cd7d-4ac9-b003-af22a85fc6b7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:09.033260 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-85d1c4c2-4f60-489b-9489-0d390df4c311 req-244b56aa-cd7d-4ac9-b003-af22a85fc6b7 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:09.047107 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-85d1c4c2-4f60-489b-9489-0d390df4c311 req-244b56aa-cd7d-4ac9-b003-af22a85fc6b7 service nova] Creating event network-vif-plugged:bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5 for instance 9aaad586-58b7-4331-9139-ec953988ca2e on hv-cinder-81558 Aug 05 06:01:09.052165 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-85d1c4c2-4f60-489b-9489-0d390df4c311 req-244b56aa-cd7d-4ac9-b003-af22a85fc6b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037024 Aug 05 06:01:09.052717 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 967/1954] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:01:09.951288 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:09.952553 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:09.963194 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:09.963678 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:09.964154 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:09.964848 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:09.965300 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:09.965724 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:10.103385 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:10.115159 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-d6c63f07-666f-4723-bfb4-4faf55904757 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1266 microversion: 2.1 time: 0.170119 Aug 05 06:01:10.115879 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 988/1955] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:09 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:11.141707 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:11.143158 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:11.156436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:11.157226 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:11.157933 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:11.159112 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:11.159889 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:11.160583 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:11.304088 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:11.311861 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-da94f520-61cd-438f-8903-3ebee96f2f16 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1453 microversion: 2.1 time: 0.177490 Aug 05 06:01:11.312409 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 968/1956] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:11 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:11.334944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:01:11.335578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:01:11.342175 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:11.342648 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:11.343077 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:11.343945 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:11.344393 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:11.344844 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:11.478441 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:01:11.486322 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-5792bbfb-46ac-4ab3-82c3-0c5ef9784ac8 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1453 microversion: 2.1 time: 0.155300 Aug 05 06:01:11.486899 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 989/1957] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:01:11 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:01:13.389646 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-ea9891ef-9adb-49b0-b901-0700ef5b3682 req-af8091cb-3b1c-4d00-a3d0-21b77206a352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aaad586-58b7-4331-9139-ec953988ca2e", "tag": "bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:01:13.399362 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ea9891ef-9adb-49b0-b901-0700ef5b3682 req-af8091cb-3b1c-4d00-a3d0-21b77206a352 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:01:13.399854 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ea9891ef-9adb-49b0-b901-0700ef5b3682 req-af8091cb-3b1c-4d00-a3d0-21b77206a352 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:01:13.400337 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-ea9891ef-9adb-49b0-b901-0700ef5b3682 req-af8091cb-3b1c-4d00-a3d0-21b77206a352 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:01:13.411883 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-ea9891ef-9adb-49b0-b901-0700ef5b3682 req-af8091cb-3b1c-4d00-a3d0-21b77206a352 service nova] Creating event network-changed:bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5 for instance 9aaad586-58b7-4331-9139-ec953988ca2e on hv-cinder-81558 Aug 05 06:01:13.417264 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-ea9891ef-9adb-49b0-b901-0700ef5b3682 req-af8091cb-3b1c-4d00-a3d0-21b77206a352 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031522 Aug 05 06:01:13.417865 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 969/1958] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:01:33.302135 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:01:33.303039 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 06:01:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:01:41.622583 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:01:41.623540 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 06:01:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:01:42.091356 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:01:42.091613 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 06:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:01:59.183286 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:01:59.184306 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 06:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:02:35.770952 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_api:SELECT=20 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:02:35.771982 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG dbcounter [-] [117902] Writing DB stats nova_cell1:SELECT=48 {{(pid=117902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:02:35.774347 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:02:35.775101 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG dbcounter [-] [117903] Writing DB stats nova_cell1:SELECT=44 {{(pid=117903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:02:35.776152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:35.776657 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:35.795597 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:35.796123 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:35.796562 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:35.797275 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:35.797725 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:35.798152 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:35.827928 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Going to try to terminate instance {{(pid=117902) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 06:02:35.913852 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-dec9c31d-2e25-4eaa-9978-5429825a1bbb tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 204 len: 0 microversion: 2.1 time: 0.144598 Aug 05 06:02:35.915065 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 990/1959] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 06:02:35 2022] DELETE /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 06:02:35.924855 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:35.925578 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:35.929963 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [req-b17e8289-4d3f-4f6a-ad91-ca6c482d2911 req-8fa521b6-ffdc-4789-b146-01dd724f384f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aaad586-58b7-4331-9139-ec953988ca2e", "tag": "bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5"}]} {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:02:35.931779 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:35.932482 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:35.932916 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:35.933611 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:35.934066 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:35.934658 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:35.940537 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b17e8289-4d3f-4f6a-ad91-ca6c482d2911 req-8fa521b6-ffdc-4789-b146-01dd724f384f service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:35.941120 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b17e8289-4d3f-4f6a-ad91-ca6c482d2911 req-8fa521b6-ffdc-4789-b146-01dd724f384f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:35.941620 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [req-b17e8289-4d3f-4f6a-ad91-ca6c482d2911 req-8fa521b6-ffdc-4789-b146-01dd724f384f service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:35.953243 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.compute.server_external_events [req-b17e8289-4d3f-4f6a-ad91-ca6c482d2911 req-8fa521b6-ffdc-4789-b146-01dd724f384f service nova] Creating event network-changed:bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5 for instance 9aaad586-58b7-4331-9139-ec953988ca2e on hv-cinder-81558 Aug 05 06:02:35.958436 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [req-b17e8289-4d3f-4f6a-ad91-ca6c482d2911 req-8fa521b6-ffdc-4789-b146-01dd724f384f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186523 Aug 05 06:02:35.959113 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 970/1960] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:02:36.069132 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:02:36.078235 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-620ee20f-c655-49cc-8d54-299644f09f6d tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1578 microversion: 2.1 time: 0.158145 Aug 05 06:02:36.079137 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 991/1961] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:35 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:02:37.107906 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:37.108626 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:37.115222 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:37.115714 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:37.116169 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:37.116855 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:37.117302 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:37.117743 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:37.374628 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:02:37.384324 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-7b1d1363-fab7-4797-a225-9c93acfd9090 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1578 microversion: 2.1 time: 0.281329 Aug 05 06:02:37.384890 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 971/1962] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:37 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1578 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:02:38.107453 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-5268ade5-a094-4df8-aba1-d15663cc4795 req-c9da8058-5fd9-4e16-b745-920d290f5186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aaad586-58b7-4331-9139-ec953988ca2e", "name": "network-vif-deleted", "tag": "bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:02:38.117876 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5268ade5-a094-4df8-aba1-d15663cc4795 req-c9da8058-5fd9-4e16-b745-920d290f5186 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:38.118359 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5268ade5-a094-4df8-aba1-d15663cc4795 req-c9da8058-5fd9-4e16-b745-920d290f5186 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:38.118768 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-5268ade5-a094-4df8-aba1-d15663cc4795 req-c9da8058-5fd9-4e16-b745-920d290f5186 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:38.130302 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-5268ade5-a094-4df8-aba1-d15663cc4795 req-c9da8058-5fd9-4e16-b745-920d290f5186 service nova] Creating event network-vif-deleted:bb245cc0-90e6-4da5-b2f1-c5bdb1b2dea5 for instance 9aaad586-58b7-4331-9139-ec953988ca2e on hv-cinder-81558 Aug 05 06:02:38.136330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-5268ade5-a094-4df8-aba1-d15663cc4795 req-c9da8058-5fd9-4e16-b745-920d290f5186 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032631 Aug 05 06:02:38.137347 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 992/1963] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:02:38.406153 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:38.406734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:38.414656 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:38.415139 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:38.415566 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:38.416433 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:38.416771 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:38.417197 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:38.482640 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:02:38.490680 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-f389e7cb-ed58-4cc0-8796-599df88a1fe9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 200 len: 1226 microversion: 2.1 time: 0.088923 Aug 05 06:02:38.491539 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 972/1964] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:38 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:02:39.514894 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:39.515604 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 9aaad586-58b7-4331-9139-ec953988ca2e] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:39.522727 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:39.523222 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:39.523654 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:39.524366 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:39.524805 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:39.525219 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:39.539289 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] HTTP exception thrown: Instance 9aaad586-58b7-4331-9139-ec953988ca2e could not be found. Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Request method failure captured: Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e HTTP/1.1 Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LEIMjOnWdn5eE5XLYFr8n9Ky4No9wEXREj9Nn36Uka_gq5eOtL088TPGQ9IQ-MTTyBsgyKDb7v6Rv5kxRaj2TlKugeyOpVZSJoZ7jHfe_gduwNOBYG3wbzddF1m0LIsueoyTnG-Mj0r-WzxHljoMTDssAum7euxT6VqWKLZsjHBx_A Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 06:02:39.540946 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d93689b1aaa347368f1f590eb6b494cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 4f727e9d632e4592b82ebd1f00cdf8df Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 9aaad586-58b7-4331-9139-ec953988ca2e could not be found. Aug 05 06:02:39.542225 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '9aaad586-58b7-4331-9139-ec953988ca2e'} Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aaad586-58b7-4331-9139-ec953988ca2e could not be found. Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 06:02:39.542927 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aaad586-58b7-4331-9139-ec953988ca2e could not be found. Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aaad586-58b7-4331-9139-ec953988ca2e could not be found. Aug 05 06:02:39.544557 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:39.546210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Returning 404 to user: Instance 9aaad586-58b7-4331-9139-ec953988ca2e could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 06:02:39.546210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-c9bdfcdb-6cf0-4457-945e-2aabdc362cdd tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e" status: 404 len: 111 microversion: 2.1 time: 0.032450 Aug 05 06:02:39.546210 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 993/1965] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:39 2022] GET /compute/v2.1/servers/9aaad586-58b7-4331-9139-ec953988ca2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 06:02:42.665314 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:42.665994 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:42.667158 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-ad8bde67-7fdf-4aca-afc9-9fecffbede55 req-1f7ef24d-7f42-4e55-9364-2e240029eef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db34ac0-8485-4b5c-93c0-a19ed842cfe1", "tag": "e247070a-eb79-4d63-a455-8dd9b72e6ea8"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:02:42.672910 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:42.673594 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:42.674027 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:42.674734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:42.675180 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:42.675803 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:42.678511 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-ad8bde67-7fdf-4aca-afc9-9fecffbede55 req-1f7ef24d-7f42-4e55-9364-2e240029eef6 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:42.679223 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-ad8bde67-7fdf-4aca-afc9-9fecffbede55 req-1f7ef24d-7f42-4e55-9364-2e240029eef6 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:42.679744 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-ad8bde67-7fdf-4aca-afc9-9fecffbede55 req-1f7ef24d-7f42-4e55-9364-2e240029eef6 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:42.691050 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-ad8bde67-7fdf-4aca-afc9-9fecffbede55 req-1f7ef24d-7f42-4e55-9364-2e240029eef6 service nova] Creating event network-changed:e247070a-eb79-4d63-a455-8dd9b72e6ea8 for instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 on hv-cinder-81558 Aug 05 06:02:42.696951 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-ad8bde67-7fdf-4aca-afc9-9fecffbede55 req-1f7ef24d-7f42-4e55-9364-2e240029eef6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033455 Aug 05 06:02:42.697990 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 994/1966] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:02:42.702365 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Going to try to terminate instance {{(pid=117903) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 06:02:42.786339 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-5e464181-33d9-41c5-929e-d43c9a29a4a7 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 204 len: 0 microversion: 2.1 time: 0.124705 Aug 05 06:02:42.786949 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 973/1967] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 06:02:42 2022] DELETE /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 06:02:42.796365 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:42.797073 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:42.803666 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:42.804271 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:42.804769 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:42.805525 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:42.806054 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:42.806576 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:42.945843 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.policy [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117902) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:02:42.953726 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-bbbe48e2-6515-4add-a1aa-e27fa331b5e4 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1578 microversion: 2.1 time: 0.161986 Aug 05 06:02:42.954328 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 995/1968] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:42 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:02:43.976084 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:43.976788 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:43.983503 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:43.984035 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:43.984468 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:43.985164 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:43.985612 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:43.986000 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:44.126102 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:02:44.134141 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b1861605-44e6-46b1-9393-b4a19c1f4d2c tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1578 microversion: 2.1 time: 0.162448 Aug 05 06:02:44.134712 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 974/1969] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:43 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:02:45.063565 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [req-4586274c-9928-4c9d-900b-5897cf239309 req-116c810f-f701-4b9c-b453-3eada58dcfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db34ac0-8485-4b5c-93c0-a19ed842cfe1", "name": "network-vif-deleted", "tag": "e247070a-eb79-4d63-a455-8dd9b72e6ea8"}]} {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 06:02:45.073391 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-4586274c-9928-4c9d-900b-5897cf239309 req-116c810f-f701-4b9c-b453-3eada58dcfd2 service nova] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:45.074699 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-4586274c-9928-4c9d-900b-5897cf239309 req-116c810f-f701-4b9c-b453-3eada58dcfd2 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:45.075164 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [req-4586274c-9928-4c9d-900b-5897cf239309 req-116c810f-f701-4b9c-b453-3eada58dcfd2 service nova] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:45.086499 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.compute.server_external_events [req-4586274c-9928-4c9d-900b-5897cf239309 req-116c810f-f701-4b9c-b453-3eada58dcfd2 service nova] Creating event network-vif-deleted:e247070a-eb79-4d63-a455-8dd9b72e6ea8 for instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 on hv-cinder-81558 Aug 05 06:02:45.091360 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [req-4586274c-9928-4c9d-900b-5897cf239309 req-116c810f-f701-4b9c-b453-3eada58dcfd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094244 Aug 05 06:02:45.092044 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 996/1970] 10.222.0.30 () {64 vars in 1317 bytes} [Fri Aug 5 06:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 06:02:45.158624 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:45.159639 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:45.166800 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:45.167290 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:45.167796 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:45.168775 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:45.169294 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:45.169721 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:45.237527 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.policy [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f727e9d632e4592b82ebd1f00cdf8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93689b1aaa347368f1f590eb6b494cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117903) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 06:02:45.245487 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-3f53563b-2c39-4263-b890-77b6795d38a9 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 200 len: 1226 microversion: 2.1 time: 0.093395 Aug 05 06:02:45.246097 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 975/1971] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:45 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 06:02:46.272345 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:46.273020 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: 0db34ac0-8485-4b5c-93c0-a19ed842cfe1] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:46.280442 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:46.280978 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:46.281449 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:46.282198 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:46.282700 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:46.283160 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:46.298047 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] HTTP exception thrown: Instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 could not be found. Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Request method failure captured: Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 HTTP/1.1 Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LEIMjOnWdn5eE5XLYFr8n9Ky4No9wEXREj9Nn36Uka_gq5eOtL088TPGQ9IQ-MTTyBsgyKDb7v6Rv5kxRaj2TlKugeyOpVZSJoZ7jHfe_gduwNOBYG3wbzddF1m0LIsueoyTnG-Mj0r-WzxHljoMTDssAum7euxT6VqWKLZsjHBx_A Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 06:02:46.299856 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d93689b1aaa347368f1f590eb6b494cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 4f727e9d632e4592b82ebd1f00cdf8df Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 could not be found. Aug 05 06:02:46.301351 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': '0db34ac0-8485-4b5c-93c0-a19ed842cfe1'} Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 could not be found. Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 06:02:46.302056 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 could not be found. Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 could not be found. Aug 05 06:02:46.303680 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.305052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Returning 404 to user: Instance 0db34ac0-8485-4b5c-93c0-a19ed842cfe1 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 06:02:46.305052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-ee708913-fd5c-4fbe-8e0f-fdffd98ed967 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1" status: 404 len: 111 microversion: 2.1 time: 0.036174 Aug 05 06:02:46.305052 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 997/1972] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:46 2022] GET /compute/v2.1/servers/0db34ac0-8485-4b5c-93c0-a19ed842cfe1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 06:02:46.748849 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:46.749384 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.compute.api [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117903) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:46.756360 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:46.756842 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:46.757271 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:46.757965 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:46.758415 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:46.758806 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG oslo_concurrency.lockutils [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:46.772344 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.wsgi [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] HTTP exception thrown: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Request method failure captured: Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: request: DELETE /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 HTTP/1.1 Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept: application/json Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Accept-Encoding: identity Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Connection: close Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Length: 0 Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Content-Type: application/json Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Host: 10.222.0.30 Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Openstack-System-Scope: None Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: User-Agent: python-urllib3/1.26.11 Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Auth-Token: gAAAAABi7LEIMjOnWdn5eE5XLYFr8n9Ky4No9wEXREj9Nn36Uka_gq5eOtL088TPGQ9IQ-MTTyBsgyKDb7v6Rv5kxRaj2TlKugeyOpVZSJoZ7jHfe_gduwNOBYG3wbzddF1m0LIsueoyTnG-Mj0r-WzxHljoMTDssAum7euxT6VqWKLZsjHBx_A Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Id: None Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Domain-Name: None Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Identity-Status: Confirmed Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Is-Admin-Project: True Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Id: default Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Domain-Name: Default Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Project-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Role: reader,member Aug 05 06:02:46.774011 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Roles: reader,member Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d93689b1aaa347368f1f590eb6b494cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-Tenant-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Id: default Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Domain-Name: Default Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Id: 4f727e9d632e4592b82ebd1f00cdf8df Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: X-User-Name: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: method: > Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: exception: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.775309 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: action_args: {'id': 'a8cc6fea-ff45-4fab-80eb-202ca0225928'} Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 06:02:46.776036 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.777099 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.778185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Returning 404 to user: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. {{(pid=117903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 06:02:46.778185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-6113202e-1c17-4dac-b278-30563d82ae35 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 404 len: 111 microversion: 2.1 time: 0.030559 Aug 05 06:02:46.778185 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 976/1973] 10.222.0.30 () {58 vars in 1239 bytes} [Fri Aug 5 06:02:46 2022] DELETE /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 06:02:46.784242 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '>' {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:46.784853 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.compute.api [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] [instance: a8cc6fea-ff45-4fab-80eb-202ca0225928] Fetching instance by UUID {{(pid=117902) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 06:02:46.792330 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:46.792837 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:46.793268 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:46.793949 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Acquiring lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 06:02:46.794389 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 06:02:46.794803 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG oslo_concurrency.lockutils [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Lock "d40b831a-f22f-4ca8-ad5d-c9bb9a692e13" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 06:02:46.808451 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.wsgi [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] HTTP exception thrown: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Request method failure captured: Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: request: GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 HTTP/1.1 Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept: application/json Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Accept-Encoding: identity Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Connection: close Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Length: 0 Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Content-Type: application/json Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Host: 10.222.0.30 Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Openstack-System-Scope: None Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: User-Agent: python-urllib3/1.26.11 Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Auth-Token: gAAAAABi7LEIMjOnWdn5eE5XLYFr8n9Ky4No9wEXREj9Nn36Uka_gq5eOtL088TPGQ9IQ-MTTyBsgyKDb7v6Rv5kxRaj2TlKugeyOpVZSJoZ7jHfe_gduwNOBYG3wbzddF1m0LIsueoyTnG-Mj0r-WzxHljoMTDssAum7euxT6VqWKLZsjHBx_A Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Id: None Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Domain-Name: None Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Identity-Status: Confirmed Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Is-Admin-Project: True Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Id: default Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Domain-Name: Default Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Project-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Role: reader,member Aug 05 06:02:46.809944 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Roles: reader,member Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d93689b1aaa347368f1f590eb6b494cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d93689b1aaa347368f1f590eb6b494cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}] Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Id: d93689b1aaa347368f1f590eb6b494cb Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-Tenant-Name: tempest-TestVolumeBootPattern-490682024 Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Id: default Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Domain-Name: Default Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Id: 4f727e9d632e4592b82ebd1f00cdf8df Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: X-User-Name: tempest-TestVolumeBootPattern-490682024-project Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: method: > Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: exception: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.811413 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: action_args: {'id': 'a8cc6fea-ff45-4fab-80eb-202ca0225928'} Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: {{(pid=117902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 06:02:46.812280 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. Aug 05 06:02:46.813531 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: ERROR nova.api.openstack.wsgi Aug 05 06:02:46.814644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: DEBUG nova.api.openstack.wsgi [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Returning 404 to user: Instance a8cc6fea-ff45-4fab-80eb-202ca0225928 could not be found. {{(pid=117902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 06:02:46.814644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO nova.api.openstack.requestlog [None req-e2b332c8-b160-40f8-a9b0-984893afc4e2 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928" status: 404 len: 111 microversion: 2.1 time: 0.030918 Aug 05 06:02:46.814644 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: [pid: 117902|app: 0|req: 998/1974] 10.222.0.30 () {58 vars in 1236 bytes} [Fri Aug 5 06:02:46 2022] GET /compute/v2.1/servers/a8cc6fea-ff45-4fab-80eb-202ca0225928 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 06:02:48.116219 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: DEBUG nova.api.openstack.wsgi [None req-b0667a17-aeb8-421b-953a-61716cac7e53 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] Calling method '.version_select at 0x7fdc9daca430>' {{(pid=117903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 06:02:48.141708 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO nova.api.openstack.requestlog [None req-b0667a17-aeb8-421b-953a-61716cac7e53 tempest-TestVolumeBootPattern-490682024 tempest-TestVolumeBootPattern-490682024-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1947595121" status: 202 len: 0 microversion: 2.1 time: 0.029336 Aug 05 06:02:48.142367 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: [pid: 117903|app: 0|req: 977/1975] 10.222.0.30 () {58 vars in 1263 bytes} [Fri Aug 5 06:02:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1947595121 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 06:05:01.636304 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:05:01.636961 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 06:05:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:05:02.103282 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:05:02.103564 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 06:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:05:19.195609 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:05:19.196710 dv-cinder-815582-14-iscsi devstack@n-api.service[117902]: Fri Aug 5 06:05:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:05:22.019206 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:05:22.019734 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 06:05:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:06:41.497543 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:06:41.498633 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 06:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 06:08:13.317484 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 06:08:13.318132 dv-cinder-815582-14-iscsi devstack@n-api.service[117903]: Fri Aug 5 06:08:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!